Sep 10 17:01:13 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 17:01:13 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 17:01:13 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 17:01:15 devstack cinder-volume[75062]: INFO dbcounter [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Registered counter for database cinder
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG dbcounter [-] [75062] Writer thread running {{(pid=75062) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 17:01:15 devstack cinder-volume[75062]: INFO cinder.rpc [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 17:01:15 devstack cinder-volume[75062]: INFO cinder.rpc [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:01:15 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Determined volume DB was empty at startup.
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG cinder.volume.manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75062) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 17:01:15 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 17:01:15 devstack cinder-volume[75062]: WARNING stevedore.named [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 17:01:15 devstack cinder-volume[75062]: WARNING castellan.key_manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 17:01:15 devstack cinder-volume[75062]: WARNING cinder.keymgr.conf_key_mgr [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG cinder.volume.drivers.lvm [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75062) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 10 17:01:15 devstack cinder-volume[75062]: DEBUG oslo_concurrency.processutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75062) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:16 devstack cinder-volume[75062]: DEBUG oslo_concurrency.processutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] CMD "cinder-rtstool verify" returned: 0 in 1.280s {{(pid=75062) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:01:17 devstack cinder-volume[75062]: INFO cinder.rpc [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 10 17:01:17 devstack cinder-volume[75062]: INFO cinder.rpc [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 10 17:01:17 devstack cinder-volume[75062]: WARNING stevedore.named [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 17:01:17 devstack cinder-volume[75062]: WARNING castellan.key_manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 17:01:17 devstack cinder-volume[75062]: INFO cinder.volume.manager [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_db.sqlalchemy.engines [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:01:17 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Starting 1 workers
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Started child 75162 {{(pid=75062) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 17:01:17 devstack cinder-volume[75162]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Full set of CONF: {{(pid=75062) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] ******************************************************************************** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Configuration options gathered from: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] ================================================================================ {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] allow_availability_zone_fallback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] allow_compression_on_image_upload = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] allowed_direct_url_schemes     = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] api_rate_limit                 = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] auth_strategy                  = keystone {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] az_cache_duration              = 3600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_availability_zone      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_host                   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_name                   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_stats_polling_interval = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backup_api_class               = cinder.backup.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backup_name_template           = backup-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backup_use_same_host           = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backup_use_temp_snapshot       = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] chap_password                  = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] chap_username                  =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_internal_tenant_project_id = a10ba56541d34f8db434abfb7b8fb4af {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_internal_tenant_user_id = 61821522f2ac40b9896f5bb6acd510cc {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cloned_volume_same_az          = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cluster                        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] compression_format             = gzip {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] config_dir                     = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] config_source                  = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] control_exchange               = openstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] debug                          = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] default_availability_zone      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] default_group_type             = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] default_volume_type            = lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_client_cert             = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_client_cert_key         = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_data_namespace          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_ssl_cert_path           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_ssl_cert_verify         = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] driver_use_ssl                 = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] enable_force_upload            = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] enable_new_services            = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] enable_unsupported_driver      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] enforce_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] filter_function                = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_api_insecure            = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_api_servers             = ['http://192.168.122.11/image'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_api_ssl_compression     = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_ca_certificates_file    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_certfile                = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_keyfile                 = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_num_retries             = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] glance_request_timeout         = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] goodness_function              = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] graceful_shutdown_timeout      = 5 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] group_api_class                = cinder.group.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] host                           = devstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_compress_on_upload       = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_conversion_address_space_limit = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_conversion_cpu_limit     = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_conversion_disable       = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_upload_use_cinder_backend = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_upload_use_internal_tenant = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_volume_cache_enabled     = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_volume_cache_max_count   = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] image_volume_cache_max_size_gb = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] init_host_max_objects_retrieval = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iscsi_iotype                   = fileio {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iscsi_target_flags             =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iscsi_write_cache              = on {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iser_helper                    = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iser_ip_address                = 192.168.122.11 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iser_port                      = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_color                      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_config_append              = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_dir                        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_file                       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_options                    = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_rotate_interval            = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_rotate_interval_type       = days {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] log_rotation_type              = none {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] max_age                        = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] max_logfile_count              = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] max_logfile_size_mb            = 200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] max_over_subscription_ratio    = 20.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] message_reap_interval          = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] message_ttl                    = 2592000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] migration_create_volume_timeout_secs = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] monkey_patch                   = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] monkey_patch_modules           = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] my_ip                          = 192.168.122.11 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] no_snapshot_gb_quota           = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] num_iser_scan_tries            = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] num_shell_tries                = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] num_volume_device_scan_tries   = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] nvmeof_conn_info_version       = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] nvmet_ns_id                    = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] nvmet_port_id                  = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_max_limit                = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:17 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_ext_list          = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_listen_port       = 8776 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_use_ssl           = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] osapi_volume_workers           = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] per_volume_size_limit          = -1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] periodic_fuzzy_delay           = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] periodic_interval              = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] public_endpoint                = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] publish_errors                 = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_backup_gigabytes         = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_backups                  = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_gigabytes                = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_groups                   = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_snapshots                = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] quota_volumes                  = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] rate_limit_burst               = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] rate_limit_except_level        = CRITICAL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] rate_limit_interval            = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] reinit_driver_count            = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] replication_device             = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] report_discard_supported       = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] report_interval                = 120 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] reservation_clean_interval     = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] reservation_expire             = 86400 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] reserved_image_namespaces      = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] reserved_percentage            = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] rpc_response_timeout           = 120 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] run_external_periodic_tasks    = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] scst_target_driver             = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] scst_target_iqn_name           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_down_time              = 720 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] shell_completion               = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] snapshot_name_template         = snapshot-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] snapshot_same_host             = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] split_loggers                  = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] state_path                     = /opt/stack/data/cinder {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] storage_availability_zone      = nova {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] storage_protocol               = iSCSI {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] syslog_log_facility            = LOG_USER {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_helper                  = lioadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_ip_address              = 192.168.122.11 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_port                    = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_protocol                = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] target_secondary_ip_addresses  = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] trace_flags                    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] transport_url                  = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] until_refresh                  = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_chap_auth                  = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_default_quota_class        = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_journal                    = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_json                       = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_multipath_for_image_xfer   = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_stderr                     = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] use_syslog                     = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] verify_glance_signatures       = enabled {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_api_class               = cinder.volume.api.API {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_backend_name            = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_clear                   = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_clear_ionice            = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_clear_size              = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75162]: INFO cinder.volume.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_copy_bps_limit          = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_dd_blocksize            = 1M {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_name_template           = volume-%s {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_service_inithost_offload = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volume_usage_audit_period      = month {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] watch_log_file                 = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] zoning_mode                    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_concurrency.disable_process_locking = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.admin_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.admin_token = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.admin_user  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_protocol = https {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_type   = password {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_uri    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.auth_version = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.cache       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.certfile    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.identity_uri = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.include_service_catalog = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.insecure    = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.interface   = public {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.keyfile     = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_password =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcache_username =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.region_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.service_type = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.backend                  = dogpile.cache.null {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.backend_argument         = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.backend_expiration_time  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.config_prefix            = cache.oslo {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.dead_timeout             = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.debug_cache_backend      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.enable_retry_client      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.enable_socket_keepalive  = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.enabled                  = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.enforce_fips_mode        = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.expiration_time          = 600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.hashclient_retry_attempts = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_dead_retry      = 300 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_password        = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_sasl_enabled    = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.memcache_username        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.proxies                  = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_db                 = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_password           = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_server             = localhost:6379 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_socket_timeout     = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.redis_username           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.retry_attempts           = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.retry_delay              = 0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.socket_keepalive_count   = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.socket_keepalive_idle    = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.socket_keepalive_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.tls_allowed_ciphers      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.tls_cafile               = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.tls_certfile             = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.tls_enabled              = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cache.tls_keyfile              = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] coordination.backend_url       = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.asyncio_connection    = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.asyncio_slave_connection = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.backend               = sqlalchemy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.connection            = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.connection_debug      = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.connection_parameters =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.connection_recycle_time = 3600 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.connection_trace      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.db_inc_retry_interval = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.db_max_retries        = 20 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.db_max_retry_interval = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.db_retry_interval     = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.max_overflow          = 50 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.max_pool_size         = 5 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.max_retries           = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.mysql_wsrep_sync_wait = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.pool_timeout          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.retry_interval        = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.slave_connection      = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.sqlite_synchronous    = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] database.use_db_reconnect      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.connection_string     = messaging:// {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.enabled               = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.es_doc_type           = notification {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.es_scroll_size        = 10000 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.es_scroll_time        = 2m {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.filter_error_trace    = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.hmac_keys             = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.sentinel_service_name = mymaster {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.socket_timeout        = 0.1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.trace_requests        = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler.trace_sqlalchemy      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler_jaeger.process_tags   = {} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler_jaeger.service_name_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] profiler_otlp.service_name_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.enforce_new_defaults = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: WARNING oslo_config.cfg [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.enforce_scope      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.policy_default_rule = default {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.215s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.group          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.helper_command = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] privsep_osbrick.user           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.group         = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.helper_command = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] cinder_sys_admin.user          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.auth_section      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.auth_type         = password {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.certfile          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.collect_timing    = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.insecure          = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.keyfile           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.send_service_user_token = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.split_loggers     = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] service_user.timeout           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.backend_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.chap_password = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.chap_username =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_client_cert = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_client_cert_key = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_data_namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.driver_use_ssl = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.extra_capabilities = {} {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.filter_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.goodness_function = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iscsi_target_flags =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iscsi_write_cache = on {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iser_port     = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.lvm_share_target = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.lvm_type      = auto {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.num_shell_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.replication_device = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.report_discard_supported = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.reserved_percentage = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_helper = tgtadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_port   = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_protocol = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.trace_flags   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.unique_fqdn_network = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.use_chap_auth = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_backend_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_clear  = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_clear_ionice = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_clear_size = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_reports.file_event_handler = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_reports.log_dir           = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.backend_host       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.chap_password      = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.chap_username      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_client_cert = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.extra_capabilities = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.filter_function    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.goodness_function  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iser_helper        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iser_port          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.lvm_type           = auto {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.replication_device = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.report_discard_supported = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.reserved_percentage = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.scst_target_driver = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.storage_protocol   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_ip_address  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_port        = 3260 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.trace_flags        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_clear       = zero {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] lvmdriver-1.volumes_dir        = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_notifications.driver = [] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_notifications.retry = -1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] key_manager.fixed_key          = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.barbican_api_version  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.barbican_endpoint     = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.barbican_endpoint_type = public {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.barbican_region_name  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.cafile                = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.certfile              = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.collect_timing        = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.insecure              = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.keyfile               = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.number_of_retries     = 60 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.retry_delay           = 1 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.send_service_user_token = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.split_loggers         = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.timeout               = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.verify_ssl            = True {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican.verify_ssl_path       = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.auth_section = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.auth_type = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.cafile   = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.certfile = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.collect_timing = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.insecure = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.keyfile  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.split_loggers = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] barbican_service_user.timeout  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.approle_role_id          = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.approle_secret_id        = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.kv_mountpoint            = secret {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.kv_path                  = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.kv_version               = 2 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.namespace                = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.root_token_id            = **** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.ssl_ca_crt_file          = None {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.timeout                  = 60.0 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.use_ssl                  = False {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:01:18 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] ******************************************************************************** {{(pid=75062) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.205s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.116s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:18 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:18 devstack sudo[75215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 10 17:01:18 devstack sudo[75215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:20 devstack sudo[75215]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:20 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.138s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:20 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:21 devstack sudo[75338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:21 devstack sudo[75338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:22 devstack sudo[75338]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:22 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.989s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:22 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:01:22 devstack cinder-volume[75162]: INFO cinder.brick.local_dev.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 10 17:01:22 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:23 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:23 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:23 devstack sudo[75440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:01:23 devstack sudo[75440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:25 devstack sudo[75440]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:25 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:25 devstack cinder-volume[75162]: DEBUG cinder.brick.local_dev.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75162) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 10 17:01:25 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:25 devstack sudo[75527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:25 devstack sudo[75527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:27 devstack cinder-volume[75062]: DEBUG dbcounter [-] [75062] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75062) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:01:28 devstack sudo[75527]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:28 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.441s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:28 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:28 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.116s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:28 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:28 devstack sudo[75732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:28 devstack sudo[75732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:30 devstack sudo[75732]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:30 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.201s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:30 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:31 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:31 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:31 devstack sudo[75787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 10 17:01:31 devstack sudo[75787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:33 devstack sudo[75787]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:33 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.089s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:33 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:33 devstack sudo[75823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:01:33 devstack sudo[75823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:36 devstack sudo[75823]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:36 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.281s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:36 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:36 devstack sudo[75911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:01:36 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:38 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:38 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.524s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:39 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:39 devstack sudo[75915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:01:39 devstack sudo[75915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:41 devstack sudo[75915]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:41 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.832s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:41 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:42 devstack sudo[75921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:42 devstack sudo[75921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:44 devstack sudo[75921]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:44 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.666s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:44 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:44 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.130s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:44 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:44 devstack sudo[75927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:44 devstack sudo[75927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:47 devstack sudo[75927]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:47 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.802s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:47 devstack cinder-volume[75162]: INFO cinder.volume.drivers.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 10 17:01:47 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:47 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.155s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:47 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:47 devstack sudo[75937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:47 devstack sudo[75937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:50 devstack sudo[75937]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:50 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.839s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:50 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:01:50 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:50 devstack sudo[76049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:01:50 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:52 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.910s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:52 devstack sudo[76131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:01:52 devstack sudo[76131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:55 devstack sudo[76131]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:55 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.525s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:55 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:55 devstack sudo[76231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:01:55 devstack sudo[76231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:57 devstack sudo[76231]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:57 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.023s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:57 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:57 devstack sudo[76234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:01:57 devstack sudo[76234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:01:59 devstack sudo[76234]: pam_unix(sudo:session): session closed for user root
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.939s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:01:59 devstack cinder-volume[75162]: INFO cinder.volume.driver [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG cinder.volume.driver [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75162) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG oslo_db.sqlalchemy.engines [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75162) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writer thread running {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG cinder.db.sqlalchemy.api [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Building query based on filter {{(pid=75162) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG cinder.image.image_utils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75162) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 17:01:59 devstack cinder-volume[75162]: INFO cinder.keymgr.migration [None req-78c7b8cd-e91f-4c7b-9d11-9973b53b4fdb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:01:59 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:01:59 devstack sudo[76240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:01:59 devstack sudo[76240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:01 devstack sudo[76240]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:01 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.053s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:01 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:01 devstack sudo[76245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:01 devstack sudo[76245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:03 devstack sudo[76245]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:03 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.101s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:03 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:03 devstack sudo[76267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:02:03 devstack sudo[76267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:06 devstack sudo[76267]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:06 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.353s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:06 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:06 devstack sudo[76376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:06 devstack sudo[76376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:08 devstack sudo[76376]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.089s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:02:08 devstack cinder-volume[75162]: INFO cinder.volume.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Driver initialization completed successfully.
Sep 10 17:02:08 devstack cinder-volume[75162]: INFO cinder.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Initiating service 2 cleanup
Sep 10 17:02:08 devstack cinder-volume[75162]: INFO cinder.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Service 2 cleanup completed.
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG cinder.service [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Creating RPC server for service cinder-volume {{(pid=75162) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG cinder.service [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75162) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 17:02:08 devstack cinder-volume[75162]: INFO cinder.volume.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:02:08 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:08 devstack sudo[76396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:02:08 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:10 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:10 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.002s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:10 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:10 devstack sudo[76400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:10 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:12 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:12 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.048s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:12 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:13 devstack sudo[76408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:02:13 devstack sudo[76408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:15 devstack sudo[76408]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:15 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.153s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:15 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:15 devstack sudo[76413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:15 devstack sudo[76413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:17 devstack sudo[76413]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:17 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.007s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:17 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:02:17 devstack cinder-volume[75162]: INFO cinder.volume.manager [None req-c51536d5-e28f-4892-b3e2-c47ba6689e14 None None] Driver post RPC initialization completed successfully.
Sep 10 17:02:27 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:SELECT=4 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:02:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:02:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:02:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:52 devstack sudo[77347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:02:52 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:54 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:54 devstack sudo[77350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:54 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:56 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.372s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:56 devstack sudo[77393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:02:56 devstack sudo[77393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:02:58 devstack sudo[77393]: pam_unix(sudo:session): session closed for user root
Sep 10 17:02:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.089s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:02:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:02:59 devstack sudo[77398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:02:59 devstack sudo[77398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:03:00 devstack sudo[77398]: pam_unix(sudo:session): session closed for user root
Sep 10 17:03:01 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.024s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:03:01 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:03:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:03:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:03:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:03:52 devstack sudo[77986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:03:52 devstack sudo[77986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:03:54 devstack sudo[77986]: pam_unix(sudo:session): session closed for user root
Sep 10 17:03:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.045s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:03:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:03:54 devstack sudo[78053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:03:54 devstack sudo[78053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:03:56 devstack sudo[78053]: pam_unix(sudo:session): session closed for user root
Sep 10 17:03:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.029s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:03:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:03:56 devstack sudo[78062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:03:56 devstack sudo[78062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:03:58 devstack sudo[78062]: pam_unix(sudo:session): session closed for user root
Sep 10 17:03:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.364s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:03:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:03:59 devstack sudo[78102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:03:59 devstack sudo[78102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:04:00 devstack sudo[78102]: pam_unix(sudo:session): session closed for user root
Sep 10 17:04:00 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.005s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:04:00 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:04:27 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:SELECT=1 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:04:27 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:UPDATE=1 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:04:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:04:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:04:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:04:52 devstack sudo[78799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:04:52 devstack sudo[78799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:04:54 devstack sudo[78799]: pam_unix(sudo:session): session closed for user root
Sep 10 17:04:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.953s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:04:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:04:54 devstack sudo[78820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:04:54 devstack sudo[78820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:04:56 devstack sudo[78820]: pam_unix(sudo:session): session closed for user root
Sep 10 17:04:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.073s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:04:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:04:56 devstack sudo[78975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:04:56 devstack sudo[78975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:04:58 devstack sudo[78975]: pam_unix(sudo:session): session closed for user root
Sep 10 17:04:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.297s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:04:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:04:59 devstack sudo[79161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:04:59 devstack sudo[79161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:05:01 devstack sudo[79161]: pam_unix(sudo:session): session closed for user root
Sep 10 17:05:01 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.482s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:05:01 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:05:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:05:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:05:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:05:52 devstack sudo[81333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:05:52 devstack sudo[81333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:05:54 devstack sudo[81333]: pam_unix(sudo:session): session closed for user root
Sep 10 17:05:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.911s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:05:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:05:54 devstack sudo[81339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:05:54 devstack sudo[81339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:05:56 devstack sudo[81339]: pam_unix(sudo:session): session closed for user root
Sep 10 17:05:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:05:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:05:56 devstack sudo[81353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:05:56 devstack sudo[81353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:05:58 devstack sudo[81353]: pam_unix(sudo:session): session closed for user root
Sep 10 17:05:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.863s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:05:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:05:58 devstack sudo[81364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:05:58 devstack sudo[81364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:06:00 devstack sudo[81364]: pam_unix(sudo:session): session closed for user root
Sep 10 17:06:00 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.025s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:06:00 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:06:27 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:SELECT=1 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:06:27 devstack cinder-volume[75162]: DEBUG dbcounter [-] [75162] Writing DB stats cinder:UPDATE=1 {{(pid=75162) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:06:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:06:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:06:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:06:52 devstack sudo[81627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:06:52 devstack sudo[81627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:06:54 devstack sudo[81627]: pam_unix(sudo:session): session closed for user root
Sep 10 17:06:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.906s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:06:54 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:06:54 devstack sudo[81630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:06:54 devstack sudo[81630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:06:56 devstack sudo[81630]: pam_unix(sudo:session): session closed for user root
Sep 10 17:06:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.843s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:06:56 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:06:56 devstack sudo[81639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:06:56 devstack sudo[81639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:06:58 devstack sudo[81639]: pam_unix(sudo:session): session closed for user root
Sep 10 17:06:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.984s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:06:58 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:06:58 devstack sudo[81642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:06:58 devstack sudo[81642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:07:00 devstack sudo[81642]: pam_unix(sudo:session): session closed for user root
Sep 10 17:07:00 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.814s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:07:00 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:07:52 devstack cinder-volume[75162]: DEBUG oslo_service.periodic_task [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75162) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:07:52 devstack cinder-volume[75162]: DEBUG cinder.volume.drivers.lvm [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Updating volume stats {{(pid=75162) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 17:07:52 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:07:52 devstack sudo[82482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 17:07:52 devstack sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:07:55 devstack sudo[82482]: pam_unix(sudo:session): session closed for user root
Sep 10 17:07:55 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.853s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:07:55 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:07:55 devstack sudo[82519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:07:55 devstack sudo[82519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:07:57 devstack sudo[82519]: pam_unix(sudo:session): session closed for user root
Sep 10 17:07:57 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.456s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:07:57 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:07:57 devstack sudo[82569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 17:07:57 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:07:58 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Caught SIGTERM, stopping children
Sep 10 17:07:58 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Acquiring lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 17:07:58 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Acquired lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 17:07:58 devstack cinder-volume[75062]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Releasing lock "singleton_lock" {{(pid=75062) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 17:07:58 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Stop services. {{(pid=75062) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 10 17:07:58 devstack cinder-volume[75062]: DEBUG oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Killing children. {{(pid=75062) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 10 17:07:58 devstack cinder-volume[75062]: INFO oslo_service.backend._eventlet.service [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Waiting on 1 children to exit
Sep 10 17:08:03 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root
Sep 10 17:08:03 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 5.447s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:03 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:03 devstack cinder-volume[75162]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 10 17:08:03 devstack sudo[82647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 17:08:03 devstack sudo[82647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:08:11 devstack sudo[82647]: pam_unix(sudo:session): session closed for user root
Sep 10 17:08:11 devstack cinder-volume[75162]: DEBUG oslo_concurrency.processutils [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 7.979s {{(pid=75162) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:11 devstack cinder-volume[75162]: DEBUG cinder.manager [None req-99c57873-a588-4fd0-8d7e-4b5486a30a0e None None] Notifying Schedulers of capabilities ... {{(pid=75162) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:08:11 devstack cinder-volume[75162]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Acquiring lock "singleton_lock" {{(pid=75162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 17:08:11 devstack cinder-volume[75162]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Acquired lock "singleton_lock" {{(pid=75162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 17:08:11 devstack cinder-volume[75162]: DEBUG oslo_concurrency.lockutils [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Releasing lock "singleton_lock" {{(pid=75162) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 17:08:11 devstack cinder-volume[75162]: WARNING amqp [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 17:08:11 devstack cinder-volume[75162]: WARNING amqp [None req-5273481c-4228-4f7a-95a7-e6ef76dbd383 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 17:08:22 devstack cinder-volume[82652]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82652) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 17:08:22 devstack cinder-volume[82652]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82652) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 17:08:22 devstack cinder-volume[82652]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82652) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 17:08:25 devstack cinder-volume[82652]: INFO dbcounter [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Registered counter for database cinder
Sep 10 17:08:25 devstack cinder-volume[82652]: DEBUG oslo_db.sqlalchemy.engines [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:08:26 devstack cinder-volume[82652]: DEBUG dbcounter [-] [82652] Writer thread running {{(pid=82652) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 17:08:26 devstack cinder-volume[82652]: INFO cinder.rpc [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 17:08:26 devstack cinder-volume[82652]: INFO cinder.rpc [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 17:08:26 devstack cinder-volume[82652]: DEBUG oslo_db.sqlalchemy.engines [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:08:27 devstack cinder-volume[82652]: INFO cinder.volume.manager [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Determined volume DB was empty at startup.
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG cinder.volume.manager [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82652) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 17:08:27 devstack cinder-volume[82652]: INFO cinder.volume.manager [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 17:08:27 devstack cinder-volume[82652]: WARNING stevedore.named [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 17:08:27 devstack cinder-volume[82652]: WARNING castellan.key_manager [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 17:08:27 devstack cinder-volume[82652]: WARNING cinder.keymgr.conf_key_mgr [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 17:08:27 devstack cinder-volume[82652]: INFO cinder.volume.manager [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_db.sqlalchemy.engines [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82652) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:08:27 devstack cinder-volume[82652]: INFO oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Starting 1 workers
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Started child 82884 {{(pid=82652) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Full set of CONF: {{(pid=82652) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 17:08:27 devstack cinder-volume[82884]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] ******************************************************************************** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Configuration options gathered from: {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] ================================================================================ {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] allow_availability_zone_fallback = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] allow_compression_on_image_upload = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] allowed_direct_url_schemes     = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] api_rate_limit                 = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] auth_strategy                  = keystone {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_availability_zone      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_host                   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_name                   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_stats_polling_interval = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backup_api_class               = cinder.backup.api.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backup_name_template           = backup-%s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backup_use_same_host           = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backup_use_temp_snapshot       = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] chap_password                  = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] chap_username                  =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_internal_tenant_project_id = a10ba56541d34f8db434abfb7b8fb4af {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_internal_tenant_user_id = 61821522f2ac40b9896f5bb6acd510cc {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cluster                        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] compression_format             = gzip {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] config_dir                     = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] config_source                  = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] control_exchange               = openstack {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] debug                          = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] default_availability_zone      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] default_group_type             = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] default_volume_type            = QuobyteHD {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_client_cert             = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_client_cert_key         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_data_namespace          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_ssl_cert_path           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_ssl_cert_verify         = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] driver_use_ssl                 = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] enable_new_services            = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] enable_unsupported_driver      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] enforce_multipath_for_image_xfer = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] filter_function                = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_api_insecure            = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_api_servers             = ['http://192.168.122.11/image'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_api_ssl_compression     = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_ca_certificates_file    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_certfile                = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_keyfile                 = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_num_retries             = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] glance_request_timeout         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] goodness_function              = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] graceful_shutdown_timeout      = 5 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] group_api_class                = cinder.group.api.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] host                           = devstack {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_compress_on_upload       = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_conversion_address_space_limit = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_conversion_cpu_limit     = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_conversion_disable       = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_upload_use_cinder_backend = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_upload_use_internal_tenant = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_volume_cache_enabled     = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_volume_cache_max_count   = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] image_volume_cache_max_size_gb = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] init_host_max_objects_retrieval = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iscsi_iotype                   = fileio {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iscsi_target_flags             =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iscsi_write_cache              = on {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:27 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iser_helper                    = tgtadm {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iser_ip_address                = 192.168.122.11 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iser_port                      = 3260 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_color                      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_config_append              = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_dir                        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_file                       = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_options                    = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_rotate_interval            = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_rotate_interval_type       = days {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] log_rotation_type              = none {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] max_age                        = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] max_logfile_count              = 30 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] max_logfile_size_mb            = 200 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] max_over_subscription_ratio    = 20.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] message_reap_interval          = 86400 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] message_ttl                    = 2592000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] migration_create_volume_timeout_secs = 300 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] monkey_patch                   = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] monkey_patch_modules           = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] my_ip                          = 192.168.122.11 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] no_snapshot_gb_quota           = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] num_iser_scan_tries            = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] num_shell_tries                = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] num_volume_device_scan_tries   = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] nvmeof_conn_info_version       = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] nvmet_ns_id                    = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] nvmet_port_id                  = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_max_limit                = 1000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_ext_list          = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_listen_port       = 8776 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_use_ssl           = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] osapi_volume_workers           = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] per_volume_size_limit          = -1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] periodic_fuzzy_delay           = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] periodic_interval              = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] public_endpoint                = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] publish_errors                 = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_backup_gigabytes         = 1000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_backups                  = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_gigabytes                = 1000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_groups                   = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_snapshots                = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] quota_volumes                  = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] rate_limit_burst               = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] rate_limit_except_level        = CRITICAL {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] rate_limit_interval            = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] reinit_driver_count            = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] replication_device             = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] report_discard_supported       = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] report_interval                = 120 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] reservation_clean_interval     = 86400 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] reservation_expire             = 86400 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] reserved_image_namespaces      = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] reserved_percentage            = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] rpc_response_timeout           = 120 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] run_external_periodic_tasks    = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] scst_target_driver             = iscsi {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] scst_target_iqn_name           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_down_time              = 720 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] shell_completion               = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] snapshot_name_template         = snapshot-%s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] split_loggers                  = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] state_path                     = /opt/stack/data/cinder {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] storage_availability_zone      = nova {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] storage_protocol               = iSCSI {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] syslog_log_facility            = LOG_USER {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_helper                  = lioadm {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_ip_address              = 192.168.122.11 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_port                    = 3260 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_protocol                = iscsi {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] target_secondary_ip_addresses  = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] trace_flags                    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] transport_url                  = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] until_refresh                  = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_chap_auth                  = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_default_quota_class        = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_journal                    = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_json                       = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_multipath_for_image_xfer   = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_stderr                     = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] use_syslog                     = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] verify_glance_signatures       = enabled {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_api_class               = cinder.volume.api.API {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_backend_name            = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_clear                   = zero {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_clear_ionice            = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_clear_size              = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_copy_bps_limit          = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_dd_blocksize            = 1M {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_name_template           = volume-%s {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_service_inithost_offload = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volume_usage_audit_period      = month {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] watch_log_file                 = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] zoning_mode                    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_concurrency.disable_process_locking = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.admin_password = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.admin_token = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.admin_user  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_protocol = https {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_section = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_type   = password {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_uri    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.auth_version = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.cache       = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.certfile    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82884) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.identity_uri = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.include_service_catalog = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.insecure    = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.interface   = public {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.keyfile     = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_password =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcache_username =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.region_name = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.service_type = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.backend                  = dogpile.cache.null {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.backend_argument         = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.backend_expiration_time  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.config_prefix            = cache.oslo {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.dead_timeout             = 60.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.debug_cache_backend      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.enable_retry_client      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.enable_socket_keepalive  = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.enabled                  = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.enforce_fips_mode        = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.expiration_time          = 600 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.hashclient_retry_attempts = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_dead_retry      = 300 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_password        = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_sasl_enabled    = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.memcache_username        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.proxies                  = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_db                 = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_password           = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_server             = localhost:6379 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_socket_timeout     = 1.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.redis_username           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.retry_attempts           = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.retry_delay              = 0.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.socket_keepalive_count   = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.socket_keepalive_idle    = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.socket_keepalive_interval = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.tls_allowed_ciphers      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.tls_cafile               = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.tls_certfile             = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.tls_enabled              = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cache.tls_keyfile              = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] coordination.backend_url       = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.asyncio_connection    = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.asyncio_slave_connection = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.backend               = sqlalchemy {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.connection            = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.connection_debug      = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.connection_parameters =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.connection_recycle_time = 3600 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.connection_trace      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.db_inc_retry_interval = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.db_max_retries        = 20 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.db_max_retry_interval = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.db_retry_interval     = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.max_overflow          = 50 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.max_pool_size         = 5 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.max_retries           = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.mysql_wsrep_sync_wait = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.pool_timeout          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.retry_interval        = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.slave_connection      = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.sqlite_synchronous    = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] database.use_db_reconnect      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.connection_string     = messaging:// {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.enabled               = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.es_doc_type           = notification {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.es_scroll_size        = 10000 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.es_scroll_time        = 2m {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.filter_error_trace    = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.hmac_keys             = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.sentinel_service_name = mymaster {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.socket_timeout        = 0.1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.trace_requests        = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler.trace_sqlalchemy      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler_jaeger.process_tags   = {} {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler_jaeger.service_name_prefix = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] profiler_otlp.service_name_prefix = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.enforce_new_defaults = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: WARNING oslo_config.cfg [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.enforce_scope      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.policy_default_rule = default {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.group          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.helper_command = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] privsep_osbrick.user           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.group         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.helper_command = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] cinder_sys_admin.user          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.auth_section      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.auth_type         = password {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.certfile          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.collect_timing    = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.insecure          = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.keyfile           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.send_service_user_token = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.split_loggers     = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] service_user.timeout           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.backend_availability_zone = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.chap_password = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.chap_username =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_client_cert = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_client_cert_key = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_data_namespace = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.driver_use_ssl = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.extra_capabilities = {} {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.filter_function = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.goodness_function = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iscsi_target_flags =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iscsi_write_cache = on {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iser_port     = 3260 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_host      =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_login     = admin {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_mount_options = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_password  = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_private_key =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_share_path =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.num_shell_tries = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.quobyte_volume_url = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.replication_device = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.report_discard_supported = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.reserved_percentage = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_helper = tgtadm {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_port   = 3260 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_protocol = iscsi {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.trace_flags   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.unique_fqdn_network = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.use_chap_auth = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_backend_name = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_clear  = zero {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_clear_ionice = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_clear_size = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_reports.file_event_handler = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_reports.log_dir           = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.backend_availability_zone = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.backend_host         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.chap_password        = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.chap_username        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_client_cert   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_data_namespace = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.extra_capabilities   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.filter_function      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.goodness_function    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iscsi_iotype         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iser_helper          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iser_ip_address      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iser_port            = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_host             = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_login            = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_mount_options    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_password         = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_private_key      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_share_path       = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.num_shell_tries      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.replication_device   = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.report_discard_supported = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.reserved_percentage  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.scst_target_driver   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.storage_protocol     = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_helper        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_ip_address    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_port          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_prefix        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_protocol      = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.trace_flags          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.use_chap_auth        = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_clear         = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_clear_size    = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] QuobyteHD.volumes_dir          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:28 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_notifications.driver = [] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_notifications.retry = -1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] key_manager.fixed_key          = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.barbican_api_version  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.barbican_endpoint     = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.barbican_endpoint_type = public {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.barbican_region_name  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.cafile                = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.certfile              = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.collect_timing        = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.insecure              = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.keyfile               = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.number_of_retries     = 60 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.retry_delay           = 1 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.send_service_user_token = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.split_loggers         = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.timeout               = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.verify_ssl            = True {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican.verify_ssl_path       = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.auth_section = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.auth_type = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.cafile   = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.certfile = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.collect_timing = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.insecure = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.keyfile  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.split_loggers = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] barbican_service_user.timeout  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.approle_role_id          = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.approle_secret_id        = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.kv_mountpoint            = secret {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.kv_path                  = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.kv_version               = 2 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.namespace                = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.root_token_id            = **** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.ssl_ca_crt_file          = None {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.timeout                  = 60.0 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.use_ssl                  = False {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 17:08:29 devstack cinder-volume[82652]: DEBUG oslo_service.backend._eventlet.service [None req-309bf61c-eb82-4fe5-a8fe-eca638ec0063 None None] ******************************************************************************** {{(pid=82652) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82884) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 10 17:08:29 devstack cinder-volume[82884]: INFO cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Running cmd (subprocess): mount.quobyte {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:29 devstack quobyte-client[82901]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 17:08:29 devstack quobyte-client[82901]: Invalid parameters found, error: missing mount point.
Sep 10 17:08:29 devstack quobyte-client[82901]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 10 17:08:29 devstack quobyte-client[82901]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] CMD "mount.quobyte" returned: 1 in 0.738s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:08:29 devstack cinder-volume[82884]: INFO cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Mounting volume: 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e ...
Sep 10 17:08:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 -c /etc/quobyte/client-cinder.cfg {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:30 devstack quobyte-client[82914]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 10 17:08:30 devstack quobyte-client[82914]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 17:08:30 devstack quobyte-client[82914]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83' to display the log.
Sep 10 17:08:30 devstack quobyte-client[82918]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 10 17:08:30 devstack quobyte-client[82918]: mount.quobyte 3.25 (4fbbd59204)
Sep 10 17:08:30 devstack quobyte-client[82918]: Client UUID: U36udB1p-lSZj-ZsOM-7gSC-piswfVrYu3hI
Sep 10 17:08:30 devstack quobyte-client[82918]: Registry: osci01.corp.quobyte.com:7861
Sep 10 17:08:30 devstack quobyte-client[82918]: Volume: cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:08:30 devstack quobyte-client[82918]: FUSE version: 316
Sep 10 17:08:30 devstack quobyte-client[82918]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 10 17:08:30 devstack quobyte-client[82918]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 10 17:08:30 devstack quobyte-client[82918]: Setting total object cache size to 3352297472 bytes
Sep 10 17:08:30 devstack quobyte-client[82918]: Using FUSE low-level API
Sep 10 17:08:30 devstack quobyte-client[82918]: Caching of uid/gid to user/group name mappings is enabled
Sep 10 17:08:30 devstack quobyte-client[82918]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 10 17:08:30 devstack quobyte-client[82918]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 10 17:08:30 devstack quobyte-client[82918]: HTTP server started on port 55000
Sep 10 17:08:30 devstack quobyte-client[82918]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 10 17:08:30 devstack quobyte-client[82918]: Mount point /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 established
Sep 10 17:08:30 devstack quobyte-client[82918]: TimeSync is running and remote sync every 60 seconds
Sep 10 17:08:30 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:30 devstack quobyte-client[82918]: Ignored time synchronization message because time source took too long to respond (73 ms)
Sep 10 17:08:30 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:30 devstack quobyte-client[82918]: Opening volume cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e (a51b66ed-a7fe-4a27-802c-08c4ec2002c7)
Sep 10 17:08:30 devstack quobyte-client[82918]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 10 17:08:30 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:30 devstack quobyte-client[82918]: Failed to invalidate inode: 38: Function not implemented
Sep 10 17:08:31 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:31 devstack quobyte-client[82918]: Automatic minidump upload enabled by global system configuration
Sep 10 17:08:31 devstack quobyte-client[82918]: Announcing HTTP status server address 172.24.4.1
Sep 10 17:08:31 devstack quobyte-client[82918]: Registered as service (uuid U36udB1p-lSZj-ZsOM-7gSC-piswfVrYu3hI)
Sep 10 17:08:31 devstack quobyte-client[82918]: Quobyte Client running as pid 82918
Sep 10 17:08:31 devstack quobyte-client[82918]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 10 17:08:31 devstack quobyte-client[82918]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:31 devstack cinder-volume[82884]: INFO cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Mounting volume: 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e succeeded
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.185s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:31 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.124s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:31 devstack cinder-volume[82884]: INFO cinder.volume.driver [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.volume.driver [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82884) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_db.sqlalchemy.engines [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82884) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writer thread running {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.db.sqlalchemy.api [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Building query based on filter {{(pid=82884) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82884) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 17:08:31 devstack cinder-volume[82884]: INFO cinder.keymgr.migration [None req-d5f17739-fb4c-46ab-a5a4-16466d356963 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:08:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.092s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:08:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Driver initialization completed successfully.
Sep 10 17:08:32 devstack cinder-volume[82884]: INFO cinder.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Initiating service 3 cleanup
Sep 10 17:08:32 devstack cinder-volume[82884]: INFO cinder.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Service 3 cleanup completed.
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG cinder.service [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Creating RPC server for service cinder-volume {{(pid=82884) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG cinder.service [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82884) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 17:08:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 10 17:08:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:08:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:08:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.112s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:08:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46f48745-8ed6-41dc-98f9-99931608439a None None] Driver post RPC initialization completed successfully.
Sep 10 17:08:33 devstack quobyte-client[82918]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 17:08:37 devstack cinder-volume[82652]: DEBUG dbcounter [-] [82652] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82652) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:08:42 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:08:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:09:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:09:38 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Flow 'volume_create_manager' (25a931fd-0b4b-4d66-ac0f-2a560636587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fed1d6-454f-4ff4-85ef-add9fc3423a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fed1d6-454f-4ff4-85ef-add9fc3423a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-366274563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df4e12d8564ee9b36c7ce03ce9b07b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:09:38Z,use_quota=True,user_id='ee5afc9301434567995d882157d4a51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df53ecc-1ed9-454f-b0ca-73931b74097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df53ecc-1ed9-454f-b0ca-73931b74097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44745161-7ce8-457a-962d-36fb1eebe73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44745161-7ce8-457a-962d-36fb1eebe73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a', 'volume_name': 'volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6eafb3-8453-4d13-a3ff-1f0bfb4243be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6eafb3-8453-4d13-a3ff-1f0bfb4243be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56394fea-6fdd-4087-97b7-c08b0c131e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:39 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume 0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a', 'volume_size': 1}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-366274563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df4e12d8564ee9b36c7ce03ce9b07b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:09:38Z,use_quota=True,user_id='ee5afc9301434567995d882157d4a51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Creating volume 0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:09:39 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:09:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:09:39 devstack quobyte-client[82918]: System call of process 83174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:09:40 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=2, name=volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:09:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a 1073741824" returned: 0 in 0.950s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:09:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" returned: 0 in 0.242s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] <== create_volume: return (1320ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56394fea-6fdd-4087-97b7-c08b0c131e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94fd2c-3705-49d0-914a-4f591e921738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:09:41 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a (0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a): created successfully
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94fd2c-3705-49d0-914a-4f591e921738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:09:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Flow 'volume_create_manager' (25a931fd-0b4b-4d66-ac0f-2a560636587a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:09:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-51d890d4-08c0-4e24-b688-2061e6ea2215 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Created volume successfully.
Sep 10 17:09:51 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:09:51 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.196s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:10:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:10:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:10:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.138s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:11:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:11:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Flow 'volume_create_manager' (ce8e5171-dd8d-4164-abe3-fc64e93a5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82cfd0-ddf8-437c-9b6d-33b02eb934b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82cfd0-ddf8-437c-9b6d-33b02eb934b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-139313474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57777944-e070-48f9-8db0-9eb057e94779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3067b071a12343f7bcb157b7fb3a69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:11:48Z,use_quota=True,user_id='b28a7049b9984e38bb527b490127b2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18374577-b6f9-42be-a149-56e70be7d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18374577-b6f9-42be-a149-56e70be7d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ac9b3-00a7-4b45-806f-cd01aa8f46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ac9b3-00a7-4b45-806f-cd01aa8f46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57777944-e070-48f9-8db0-9eb057e94779', 'volume_name': 'volume-57777944-e070-48f9-8db0-9eb057e94779', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9193ab1b-f8c8-407d-bc4f-6ed419ce0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9193ab1b-f8c8-407d-bc4f-6ed419ce0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd929e6-b596-46ed-bece-f9f497b1303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:48 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume 57777944-e070-48f9-8db0-9eb057e94779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57777944-e070-48f9-8db0-9eb057e94779', 'volume_size': 1}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-139313474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57777944-e070-48f9-8db0-9eb057e94779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3067b071a12343f7bcb157b7fb3a69e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:11:48Z,use_quota=True,user_id='b28a7049b9984e38bb527b490127b2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Creating volume 57777944-e070-48f9-8db0-9eb057e94779 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:11:48 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:11:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:11:49 devstack quobyte-client[82918]: System call of process 84186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:11:49 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=3, name=volume-57777944-e070-48f9-8db0-9eb057e94779, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:11:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 1073741824" returned: 0 in 1.273s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:11:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:11:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779" returned: 0 in 0.181s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:11:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] <== create_volume: return (1593ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:11:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:11:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd929e6-b596-46ed-bece-f9f497b1303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57777944-e070-48f9-8db0-9eb057e94779', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec38a813-a570-4e3c-b358-e7ca2684a6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume volume-57777944-e070-48f9-8db0-9eb057e94779 (57777944-e070-48f9-8db0-9eb057e94779): created successfully
Sep 10 17:11:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec38a813-a570-4e3c-b358-e7ca2684a6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Flow 'volume_create_manager' (ce8e5171-dd8d-4164-abe3-fc64e93a5327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:11:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d12fa87b-ee7e-4646-b1a5-12f9416759f7 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Created volume successfully.
Sep 10 17:11:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Flow 'volume_create_manager' (6caf605a-c097-4c8b-a5bf-fc9dced7d561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f52b54c-e890-4285-8558-eec934707a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f52b54c-e890-4285-8558-eec934707a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-588070718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ee463f21c495a8529559cc86a8443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:11:55Z,use_quota=True,user_id='79928c8089314f8d9954febef5aad6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd4fc42-0707-4042-819c-b91f10c65327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd4fc42-0707-4042-819c-b91f10c65327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd02960e-c889-4bd0-8109-8996e3925a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd02960e-c889-4bd0-8109-8996e3925a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba', 'volume_name': 'volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1930bf5d-9397-4a10-a5a8-2b54fa5ebf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1930bf5d-9397-4a10-a5a8-2b54fa5ebf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1cb7f9-eb5a-4309-918f-a20661fbf585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:55 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume 1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba', 'volume_size': 1}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-588070718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ee463f21c495a8529559cc86a8443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:11:55Z,use_quota=True,user_id='79928c8089314f8d9954febef5aad6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Creating volume 1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:11:55 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:11:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:11:56 devstack quobyte-client[82918]: System call of process 84209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:11:56 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=4, name=volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:11:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba 1073741824" returned: 0 in 1.467s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:11:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:11:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" returned: 0 in 0.266s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:11:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] <== create_volume: return (2108ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:11:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:11:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1cb7f9-eb5a-4309-918f-a20661fbf585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c58feaa-15cb-4881-96f7-1c3bd0bf7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:11:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba (1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba): created successfully
Sep 10 17:11:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c58feaa-15cb-4881-96f7-1c3bd0bf7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:11:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Flow 'volume_create_manager' (6caf605a-c097-4c8b-a5bf-fc9dced7d561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:11:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-229ea804-8467-40a6-b8d3-f7d296f81480 tempest-AttachVolumeShelveTestJSON-1001509951 None] Created volume successfully.
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.187s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:12:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:12:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:12:04 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp840mxijz/privsep.sock']
Sep 10 17:12:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:12:04 devstack sudo[84249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp840mxijz/privsep.sock
Sep 10 17:12:04 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:12:14 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:14 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:15 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root
Sep 10 17:12:15 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Spawned new privsep daemon via rootwrap
Sep 10 17:12:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Accepted privsep connection to /tmp/tmp840mxijz/privsep.sock {{(pid=82884) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 10 17:12:15 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 10 17:12:15 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 10 17:12:15 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 10 17:12:15 devstack cinder-volume[82884]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84388
Sep 10 17:12:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a31242-f0c5-42fb-9e80-4b41e2f9d793]: (2,) {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:12:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18b971-c72e-4397-ba30-e949e169ba78]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:12:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" returned: 0 in 0.660s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 11.680s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:12:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:12:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1fe04f-a1b8-480c-8607-2e339cb2bab3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:12:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc3957b6-1246-4363-8795-988e92d8a977', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:12:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-6ebef12f-4cdc-4f7e-8dd1-b3a69bda79b9 req-00f3bdd6-ffa2-4cc5-b97b-d2ca3c062366 tempest-VolumesAssistedSnapshotsTest-1453715509 None] attachment_update completed successfully.
Sep 10 17:12:17 devstack quobyte-client[82918]: System call of process 84438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:12:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779" returned: 0 in 0.912s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:12:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-57777944-e070-48f9-8db0-9eb057e94779', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f80a72c-8b4b-44be-87a1-65e7105aa8a6', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:12:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-39e51b8e-829c-498a-85ef-f83800b293d3 req-d20a696a-b392-4adc-a931-896126f5dbdc tempest-AttachSCSIVolumeTestJSON-1727418727 None] attachment_update completed successfully.
Sep 10 17:12:27 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:27 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:12:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:12:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa5712-9760-4d98-9d71-1682a24b0bd2]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:12:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" returned: 0 in 0.399s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.461s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:12:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d898242-acc1-4170-ad44-03f3da70e0c4', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:12:31 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:31 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-f7fcdb93-c7e9-4463-960d-c1fee4835686 req-92ad9175-f655-48f1-9803-552ff5bd696b tempest-AttachVolumeShelveTestJSON-1001509951 None] attachment_update completed successfully.
Sep 10 17:12:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:12:47 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-8464d473-7ca8-4d2e-9c3c-9edd2aa4fb2b req-99f393ed-6821-4bf1-8069-a541c26b1947 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:47 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-8464d473-7ca8-4d2e-9c3c-9edd2aa4fb2b req-99f393ed-6821-4bf1-8069-a541c26b1947 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-8464d473-7ca8-4d2e-9c3c-9edd2aa4fb2b req-99f393ed-6821-4bf1-8069-a541c26b1947 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Terminate volume connection completed successfully.
Sep 10 17:12:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8464d473-7ca8-4d2e-9c3c-9edd2aa4fb2b req-99f393ed-6821-4bf1-8069-a541c26b1947 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Deleting attachment 0f80a72c-8b4b-44be-87a1-65e7105aa8a6. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:12:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-fc2a3b95-587a-4da7-8e6d-141829892736 req-fac080c0-eab7-4de5-a8dc-a6b65905c0d2 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-fc2a3b95-587a-4da7-8e6d-141829892736 req-fac080c0-eab7-4de5-a8dc-a6b65905c0d2 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-fc2a3b95-587a-4da7-8e6d-141829892736 req-fac080c0-eab7-4de5-a8dc-a6b65905c0d2 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Terminate volume connection completed successfully.
Sep 10 17:12:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-fc2a3b95-587a-4da7-8e6d-141829892736 req-fac080c0-eab7-4de5-a8dc-a6b65905c0d2 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Deleting attachment dc3957b6-1246-4363-8795-988e92d8a977. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "cinder-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "cinder-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:12:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "cinder-quobyte-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "cinder-quobyte-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" acquired by "delete_volume" :: waited 0.029s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5b0f1-dc08-4b72-bea1-7c7fb5cba6e2]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:12:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" returned: 0 in 1.609s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" returned: 0 in 0.105s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "cinder-quobyte-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a" released by "delete_volume" :: held 1.901s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:12:53 devstack cinder-volume[82884]: WARNING cinder.quota [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:12:53 devstack cinder-volume[82884]: WARNING cinder.quota [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Created reservations ['50d7dfe6-45a4-4f3d-ad45-6c59ad94e9a3', 'a66b9bf8-a881-45d7-a9bc-4da85244d777', '45f47a8a-22c4-4f26-9fa7-dc6231493850', '3871acca-aa7e-4df9-a41a-a4c7ff6fd686'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.223s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:12:53 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:12:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Deleted volume successfully.
Sep 10 17:12:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d06622d0-b334-47b0-82e9-88b0029196b8 tempest-VolumesAssistedSnapshotsTest-1453715509 None] Lock "cinder-0bc54c96-5d01-4d96-a54d-5dc2b1b9b16a-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.149s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:13:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:13:03 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:13:04 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "cinder-57777944-e070-48f9-8db0-9eb057e94779-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "cinder-57777944-e070-48f9-8db0-9eb057e94779-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:13:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "cinder-quobyte-57777944-e070-48f9-8db0-9eb057e94779" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "cinder-quobyte-57777944-e070-48f9-8db0-9eb057e94779" acquired by "delete_volume" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0f842-2630-45e5-9e11-53b1e35c8d94]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:13:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:13:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779" returned: 0 in 0.464s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:13:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:13:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-57777944-e070-48f9-8db0-9eb057e94779" returned: 0 in 0.148s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:13:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "cinder-quobyte-57777944-e070-48f9-8db0-9eb057e94779" released by "delete_volume" :: held 0.927s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Created reservations ['b70929aa-8802-468d-8fdf-e4a63d3db67c', '879f01a7-d61b-4f36-9ee4-e9bfe92b2f53', '7e6a86aa-ef8f-4945-ba17-b7e5bcf68dca', '36823218-53f4-491a-84ac-689e737025a4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.156s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:13:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Deleted volume successfully.
Sep 10 17:13:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-811a1566-223b-45bb-a81f-93a3538a0336 tempest-AttachSCSIVolumeTestJSON-1727418727 None] Lock "cinder-57777944-e070-48f9-8db0-9eb057e94779-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:13:17 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:13:17 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:14:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (6ef9ac33-ec00-4855-acda-3576e4b8dc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98501a72-88bc-4cd7-89da-2a74a321910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98501a72-88bc-4cd7-89da-2a74a321910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2066450390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e3df21-85f9-4010-9896-0dd23a9134b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:27Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41264b43-dea5-4d3e-a7f8-930078f183ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41264b43-dea5-4d3e-a7f8-930078f183ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7fb61-97aa-43b8-bdaf-fcf8c8216bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7fb61-97aa-43b8-bdaf-fcf8c8216bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18e3df21-85f9-4010-9896-0dd23a9134b1', 'volume_name': 'volume-18e3df21-85f9-4010-9896-0dd23a9134b1', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398298760>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420449c8-eec1-4c49-bf12-47a5ec3f1ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420449c8-eec1-4c49-bf12-47a5ec3f1ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bbb8e1-9f19-488a-9f4f-5c386bf22583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Volume 18e3df21-85f9-4010-9896-0dd23a9134b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18e3df21-85f9-4010-9896-0dd23a9134b1', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398298760>}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Cloning 18e3df21-85f9-4010-9896-0dd23a9134b1 from image 3a863299-f273-4a78-81cf-9aa7d2a025e9  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:14:28 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e2ad0-8ebe-4a37-9b72-83cb77096089]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:14:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:29 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD
Sep 10 17:14:29 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:14:32 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Sep 10 17:14:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD" returned: 0 in 3.288s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:32 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 is fetched for user a2a4cc739c43482ba7478603476e242b. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:14:32 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d5946d-4591-4eeb-990b-58245c407d93]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:14:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:33 devstack sudo[85691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD
Sep 10 17:14:33 devstack sudo[85691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:14:36 devstack sudo[85691]: pam_unix(sudo:session): session closed for user root
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD" returned: 0 in 3.562s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2066450390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e3df21-85f9-4010-9896-0dd23a9134b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:27Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Creating volume 18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:14:36 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:36 devstack quobyte-client[82918]: System call of process 85701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:14:36 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=5, name=volume-18e3df21-85f9-4010-9896-0dd23a9134b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 1073741824" returned: 0 in 0.422s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 0.101s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] <== create_volume: return (620ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.642s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Attempting download of 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 18e3df21-85f9-4010-9896-0dd23a9134b1. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac240ba1-73be-4671-8a86-c064efcf84f2]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_u6n1ncxi {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_u6n1ncxi" returned: 0 in 0.420s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_u6n1ncxi {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_u6n1ncxi" returned: 1 in 0.523s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_u6n1ncxi' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b403802b-ae0d-48d6-bcb7-b775adbdfcef]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] 3a863299-f273-4a78-81cf-9aa7d2a025e9 was qcow2, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:14:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:38 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=5, name=volume-18e3df21-85f9-4010-9896-0dd23a9134b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 1.305s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_ts56ilp_devstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:14:40 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Converted 112.00 MB image at 84.25 MB/s
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:40 devstack quobyte-client[82918]: System call of process 85720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 1G" returned: 0 in 0.138s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8ad6a-697b-4731-9aab-2a614f54b1a0]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:14:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 0.462s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 1 in 0.376s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Downloaded image 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 18e3df21-85f9-4010-9896-0dd23a9134b1 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 for user a2a4cc739c43482ba7478603476e242b is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Marking volume 18e3df21-85f9-4010-9896-0dd23a9134b1 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Copying metadata from image 3a863299-f273-4a78-81cf-9aa7d2a025e9 to 18e3df21-85f9-4010-9896-0dd23a9134b1. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Creating volume glance metadata for volume 18e3df21-85f9-4010-9896-0dd23a9134b1 backed by image 3a863299-f273-4a78-81cf-9aa7d2a025e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bbb8e1-9f19-488a-9f4f-5c386bf22583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e3df21-85f9-4010-9896-0dd23a9134b1', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398298760>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b61015-2c9c-4442-be6f-f567a0bf3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:41 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Volume volume-18e3df21-85f9-4010-9896-0dd23a9134b1 (18e3df21-85f9-4010-9896-0dd23a9134b1): created successfully
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b61015-2c9c-4442-be6f-f567a0bf3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (6ef9ac33-ec00-4855-acda-3576e4b8dc6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5e458921-b82c-4334-a4f7-b504a4bf99a7 tempest-TaggedBootDevicesTest-1271829778 None] Created volume successfully.
Sep 10 17:14:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (2d371dfe-e057-42c5-b075-f28e907a8502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62181453-8bba-4fbc-96fe-2c902f812675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62181453-8bba-4fbc-96fe-2c902f812675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-715687495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ea18f1-bc87-4142-a8e1-9d0af363d683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:43Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8910907e-2603-4753-9196-685b4d4b94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8910907e-2603-4753-9196-685b4d4b94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3601358-060f-4411-b9d0-95709638b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3601358-060f-4411-b9d0-95709638b011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ea18f1-bc87-4142-a8e1-9d0af363d683', 'volume_name': 'volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9e1b10-9b1a-44a0-a68a-c7af9f777dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d9e1b10-9b1a-44a0-a68a-c7af9f777dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0126cf-441b-41dc-a775-3a6c5aab3a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:43 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Volume a5ea18f1-bc87-4142-a8e1-9d0af363d683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683', 'volume_size': 1}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-715687495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ea18f1-bc87-4142-a8e1-9d0af363d683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:43Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Creating volume a5ea18f1-bc87-4142-a8e1-9d0af363d683 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:14:43 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:14:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:43 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=6, name=volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:14:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 1073741824" returned: 0 in 0.560s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683" returned: 0 in 1.039s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] <== create_volume: return (1696ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0126cf-441b-41dc-a775-3a6c5aab3a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1121d9c-2d56-4cf6-88df-de16bfd27f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:45 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Volume volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 (a5ea18f1-bc87-4142-a8e1-9d0af363d683): created successfully
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1121d9c-2d56-4cf6-88df-de16bfd27f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (2d371dfe-e057-42c5-b075-f28e907a8502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c1424921-77dc-436b-8f24-e8eb5f86cc43 tempest-TaggedBootDevicesTest-1271829778 None] Created volume successfully.
Sep 10 17:14:47 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (8b51da1f-0ae5-48fe-965f-67f33f42d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345639a-91ff-4df5-96c7-0aec36f497f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e345639a-91ff-4df5-96c7-0aec36f497f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1676838943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1597d53-7330-4831-954e-bb7ad2271d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:47Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a974ac-7ea2-4ed6-b07a-6a1a650c87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a974ac-7ea2-4ed6-b07a-6a1a650c87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc36461-2d20-40f0-a711-a90020c2c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc36461-2d20-40f0-a711-a90020c2c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1597d53-7330-4831-954e-bb7ad2271d93', 'volume_name': 'volume-f1597d53-7330-4831-954e-bb7ad2271d93', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbe861-fce9-4afb-ae29-98b23781a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbe861-fce9-4afb-ae29-98b23781a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b578534-1afa-4ccd-8b1c-915c77ccabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:47 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Volume f1597d53-7330-4831-954e-bb7ad2271d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1597d53-7330-4831-954e-bb7ad2271d93', 'volume_size': 1}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1676838943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1597d53-7330-4831-954e-bb7ad2271d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5151d54850854bd7aacc5a4ea956745f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:14:47Z,use_quota=True,user_id='a2a4cc739c43482ba7478603476e242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Creating volume f1597d53-7330-4831-954e-bb7ad2271d93 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:14:47 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:47 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=7, name=volume-f1597d53-7330-4831-954e-bb7ad2271d93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 1073741824" returned: 0 in 0.326s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93" returned: 0 in 0.091s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.506s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b578534-1afa-4ccd-8b1c-915c77ccabd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1597d53-7330-4831-954e-bb7ad2271d93', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef661bcd-e315-42b9-b8d6-1ef3fb1b2756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:14:48 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Volume volume-f1597d53-7330-4831-954e-bb7ad2271d93 (f1597d53-7330-4831-954e-bb7ad2271d93): created successfully
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef661bcd-e315-42b9-b8d6-1ef3fb1b2756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:14:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Flow 'volume_create_manager' (8b51da1f-0ae5-48fe-965f-67f33f42d336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:14:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2a2bc999-5650-464b-839f-5d758d22d9fd tempest-TaggedBootDevicesTest-1271829778 None] Created volume successfully.
Sep 10 17:14:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-12c044fb-00a3-420a-8505-672b7afdb33f req-d891f9ce-5bbb-4294-b405-cda2d016a442 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:14:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-12c044fb-00a3-420a-8505-672b7afdb33f req-d891f9ce-5bbb-4294-b405-cda2d016a442 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:14:56 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-12c044fb-00a3-420a-8505-672b7afdb33f req-d891f9ce-5bbb-4294-b405-cda2d016a442 tempest-AttachVolumeShelveTestJSON-1001509951 None] Terminate volume connection completed successfully.
Sep 10 17:14:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-12c044fb-00a3-420a-8505-672b7afdb33f req-d891f9ce-5bbb-4294-b405-cda2d016a442 tempest-AttachVolumeShelveTestJSON-1001509951 None] Deleting attachment 3d898242-acc1-4170-ad44-03f3da70e0c4. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.157s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.799s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:15:06 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=12,cinder:INSERT=9,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:15:06 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=10,cinder:SELECT=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:15:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Flow 'volume_create_manager' (93cafa8f-68f8-4f89-a985-00df8332bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb105ab-cdd3-4a2c-9750-87dbcfc27543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb105ab-cdd3-4a2c-9750-87dbcfc27543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1182161175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a1fa68-23e7-49ed-8301-4b00c54a4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9d4f97e1484c8cadc65ee7d1d6ae79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:15:07Z,use_quota=True,user_id='d53ee8ebbe0d4a4aa6c5633d3461d5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f85549-4091-46e1-8319-a12d0f5825df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f85549-4091-46e1-8319-a12d0f5825df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f10745-a4de-4976-ab94-2b17b68fc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f10745-a4de-4976-ab94-2b17b68fc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a1fa68-23e7-49ed-8301-4b00c54a4d48', 'volume_name': 'volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b2e43c-5902-4f42-9112-16057c509628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b2e43c-5902-4f42-9112-16057c509628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763fed57-149e-45cd-b2f4-9b261640e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Volume 64a1fa68-23e7-49ed-8301-4b00c54a4d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48', 'volume_size': 1}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1182161175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a1fa68-23e7-49ed-8301-4b00c54a4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c9d4f97e1484c8cadc65ee7d1d6ae79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:15:07Z,use_quota=True,user_id='d53ee8ebbe0d4a4aa6c5633d3461d5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Creating volume 64a1fa68-23e7-49ed-8301-4b00c54a4d48 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:15:07 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:15:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:07 devstack quobyte-client[82918]: System call of process 85897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:15:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=8, name=volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:15:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 1073741824" returned: 0 in 0.626s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48" returned: 0 in 0.235s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] <== create_volume: return (1117ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:15:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763fed57-149e-45cd-b2f4-9b261640e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec3894-31e7-46de-a0fd-14ad774c60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:15:09 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Volume volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 (64a1fa68-23e7-49ed-8301-4b00c54a4d48): created successfully
Sep 10 17:15:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dec3894-31e7-46de-a0fd-14ad774c60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:15:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Flow 'volume_create_manager' (93cafa8f-68f8-4f89-a985-00df8332bad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:15:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-23ff2885-b6b8-4dfd-8077-23bffad31fa8 tempest-VolumesAdminNegativeTest-233071841 None] Created volume successfully.
Sep 10 17:15:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Acquiring lock "cinder-64a1fa68-23e7-49ed-8301-4b00c54a4d48-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:15:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "cinder-64a1fa68-23e7-49ed-8301-4b00c54a4d48-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:15:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:15:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Acquiring lock "cinder-quobyte-64a1fa68-23e7-49ed-8301-4b00c54a4d48" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:15:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "cinder-quobyte-64a1fa68-23e7-49ed-8301-4b00c54a4d48" acquired by "delete_volume" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:15:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d55311-c0dd-4feb-8540-8771b49e8eba]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:15:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:12 devstack quobyte-client[82918]: System call of process 85908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:15:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48" returned: 0 in 0.772s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-64a1fa68-23e7-49ed-8301-4b00c54a4d48" returned: 0 in 0.273s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "cinder-quobyte-64a1fa68-23e7-49ed-8301-4b00c54a4d48" released by "delete_volume" :: held 1.519s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Created reservations ['696ae84c-f4fe-42d1-abea-c36559afd58c', 'bc4e3b6c-61f9-4043-9000-b2b3c7f03e6e', '5488bfca-e7a7-4d2b-98db-790fc2afaa45', '0bd56714-9a76-4caa-9300-be96e4b43dd4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.526s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:14 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:15:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Deleted volume successfully.
Sep 10 17:15:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-510bd249-b074-4cf5-9a99-cbaec83eeacb tempest-VolumesAdminNegativeTest-233071841 None] Lock "cinder-64a1fa68-23e7-49ed-8301-4b00c54a4d48-delete_volume" released by "delete_volume" :: held 4.651s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:15:23 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:15:25 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:15:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:26 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04bf49a-538b-41ef-bec3-fa05918b822d]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:15:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 0.762s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 1 in 0.715s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:15:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.726s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-18e3df21-85f9-4010-9896-0dd23a9134b1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34808f4d-325f-4651-9120-6f7f69f3ad0e', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:15:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:15:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-71071419-b98b-4e27-95fb-258c5be880e6 tempest-TaggedBootDevicesTest-1271829778 None] attachment_update completed successfully.
Sep 10 17:15:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:33 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42fc40-8e42-4a3c-9daf-13f398edf324]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:15:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683" returned: 0 in 0.634s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.701s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:34 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f3e6310-7cf1-41e2-9aa3-d8b20e1bbc62', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:15:34 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:15:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-3ffac096-cf75-4121-9a2d-0f0fd6b71628 tempest-TaggedBootDevicesTest-1271829778 None] attachment_update completed successfully.
Sep 10 17:15:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:15:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:15:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849e82a-65fe-4098-b4c8-1ae26ad0dd78]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:15:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:15:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93" returned: 0 in 0.781s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:15:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:15:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-f1597d53-7330-4831-954e-bb7ad2271d93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0841356-cc84-4106-9797-2fbdde091d12', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:15:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:15:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-d49f73df-7208-4f34-820e-8b38165277dd req-2ad107a4-2ac1-4654-9de6-af8bd5943a1b tempest-TaggedBootDevicesTest-1271829778 None] attachment_update completed successfully.
Sep 10 17:15:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:15:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.152s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:16:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:16:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:16:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:17:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:14 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:17:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Flow 'volume_create_manager' (f4bd1139-fd6d-458e-8f71-7556a57037f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:17:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd61a67-8a01-4d6a-be8c-0e9463500871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd61a67-8a01-4d6a-be8c-0e9463500871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-300235530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb9abd-f76b-43a7-8a83-eafad511ba97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ee463f21c495a8529559cc86a8443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:17:14Z,use_quota=True,user_id='79928c8089314f8d9954febef5aad6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1460f91d-1e4a-4015-9ddf-93cbc0e1b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1460f91d-1e4a-4015-9ddf-93cbc0e1b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6893d7-0d6f-446a-bfac-393a09496a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6893d7-0d6f-446a-bfac-393a09496a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cb9abd-f76b-43a7-8a83-eafad511ba97', 'volume_name': 'volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b9a36b-e2c7-490b-9612-b22a9de55e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b9a36b-e2c7-490b-9612-b22a9de55e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b96e96-39a2-4dff-b618-4d53b545e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:15 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume b6cb9abd-f76b-43a7-8a83-eafad511ba97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97', 'volume_size': 1}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-300235530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb9abd-f76b-43a7-8a83-eafad511ba97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852ee463f21c495a8529559cc86a8443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:17:14Z,use_quota=True,user_id='79928c8089314f8d9954febef5aad6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Creating volume b6cb9abd-f76b-43a7-8a83-eafad511ba97 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:17:15 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:17:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:15 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=9, name=volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:17:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 1073741824" returned: 0 in 1.392s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97" returned: 0 in 0.161s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] <== create_volume: return (1695ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:17:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b96e96-39a2-4dff-b618-4d53b545e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37068b45-e270-48cd-8891-46b127b84b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 (b6cb9abd-f76b-43a7-8a83-eafad511ba97): created successfully
Sep 10 17:17:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37068b45-e270-48cd-8891-46b127b84b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Flow 'volume_create_manager' (f4bd1139-fd6d-458e-8f71-7556a57037f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:17:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0ead5016-d863-43b9-9265-b51a5a0c6f72 tempest-AttachVolumeShelveTestJSON-1001509951 None] Created volume successfully.
Sep 10 17:17:27 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:17:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:27 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:17:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Flow 'volume_create_manager' (8099c97b-3a01-46e7-9517-7a1423517c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:17:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed749c2f-eb3a-4319-a1bb-372e4d39f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed749c2f-eb3a-4319-a1bb-372e4d39f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1664438652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b314d2-03f3-4af5-9d8e-8fcb74a57410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee0fa46e07945438e0b2b2bdde2b5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:17:27Z,use_quota=True,user_id='dbf5ba0566d64512b6937ade0303e6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ee029a-3e25-47b1-959f-c5b591b16c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ee029a-3e25-47b1-959f-c5b591b16c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4ad90e-e33c-44ab-9d4e-7c1c1050bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4ad90e-e33c-44ab-9d4e-7c1c1050bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b314d2-03f3-4af5-9d8e-8fcb74a57410', 'volume_name': 'volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abb9afd-4571-43c3-a675-6c7cf6af71b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abb9afd-4571-43c3-a675-6c7cf6af71b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a490f1-7f55-450d-b64f-e973626845a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Volume a2b314d2-03f3-4af5-9d8e-8fcb74a57410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410', 'volume_size': 1}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1664438652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b314d2-03f3-4af5-9d8e-8fcb74a57410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee0fa46e07945438e0b2b2bdde2b5f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:17:27Z,use_quota=True,user_id='dbf5ba0566d64512b6937ade0303e6e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Creating volume a2b314d2-03f3-4af5-9d8e-8fcb74a57410 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:17:28 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:17:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:28 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=10, name=volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:17:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 1073741824" returned: 0 in 1.080s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" returned: 0 in 0.317s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] <== create_volume: return (1559ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:17:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a490f1-7f55-450d-b64f-e973626845a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff5b0e-92b6-488b-8ce2-ad9b7273b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:17:30 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Volume volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 (a2b314d2-03f3-4af5-9d8e-8fcb74a57410): created successfully
Sep 10 17:17:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ff5b0e-92b6-488b-8ce2-ad9b7273b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:17:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Flow 'volume_create_manager' (8099c97b-3a01-46e7-9517-7a1423517c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:17:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-812c9c9a-706a-4ac8-ba28-598980db9f22 tempest-DeleteServersTestJSON-238631299 None] Created volume successfully.
Sep 10 17:17:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:17:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:17:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd5e7d-4b3c-4179-9df0-641683669db7]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:17:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:38 devstack quobyte-client[82918]: System call of process 87378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:17:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" returned: 0 in 1.172s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.268s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:17:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac494772-6675-4cef-a521-3a876e8f035e', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:17:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-e203e588-15bb-4863-9a48-397a047ee676 req-eef32744-ee59-400e-9306-26a1eb4a5914 tempest-DeleteServersTestJSON-238631299 None] attachment_update completed successfully.
Sep 10 17:17:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:17:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:17:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-53c9d790-f1a0-4937-ba6b-0c02c4ec4620 req-820a2fc8-bf23-41d3-8bd5-d053f5b87773 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-53c9d790-f1a0-4937-ba6b-0c02c4ec4620 req-820a2fc8-bf23-41d3-8bd5-d053f5b87773 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-53c9d790-f1a0-4937-ba6b-0c02c4ec4620 req-820a2fc8-bf23-41d3-8bd5-d053f5b87773 tempest-AttachVolumeShelveTestJSON-1001509951 None] No connector for attachment dd7e3763-407d-4098-bbb9-eb301526540e; skipping storage backend terminate_connection call. {{(pid=82884) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 10 17:17:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-53c9d790-f1a0-4937-ba6b-0c02c4ec4620 req-820a2fc8-bf23-41d3-8bd5-d053f5b87773 tempest-AttachVolumeShelveTestJSON-1001509951 None] Deleting attachment dd7e3763-407d-4098-bbb9-eb301526540e. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:17:54 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-371c4824-5833-4704-a9a1-90c19202a374 req-5d5f81f1-bee0-402d-b365-94b33a98a7cc tempest-DeleteServersTestJSON-238631299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:54 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-371c4824-5833-4704-a9a1-90c19202a374 req-5d5f81f1-bee0-402d-b365-94b33a98a7cc tempest-DeleteServersTestJSON-238631299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-371c4824-5833-4704-a9a1-90c19202a374 req-5d5f81f1-bee0-402d-b365-94b33a98a7cc tempest-DeleteServersTestJSON-238631299 None] Terminate volume connection completed successfully.
Sep 10 17:17:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-371c4824-5833-4704-a9a1-90c19202a374 req-5d5f81f1-bee0-402d-b365-94b33a98a7cc tempest-DeleteServersTestJSON-238631299 None] Deleting attachment ac494772-6675-4cef-a521-3a876e8f035e. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "cinder-a2b314d2-03f3-4af5-9d8e-8fcb74a57410-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "cinder-a2b314d2-03f3-4af5-9d8e-8fcb74a57410-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:17:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "cinder-quobyte-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "cinder-quobyte-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b0913-4267-4ef0-90f0-29e042af76b6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:17:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" returned: 0 in 0.595s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:17:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" returned: 0 in 0.087s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:17:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "cinder-quobyte-a2b314d2-03f3-4af5-9d8e-8fcb74a57410" released by "delete_volume" :: held 0.847s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:17:59 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Created reservations ['dd437c25-87a7-409f-be26-494adfa360f7', '94483db7-8df9-4df4-bc07-7f3c5e89c988', 'e4f10f11-b8d6-4a3a-95e6-564186d52d77', '2b73aaa0-0d52-4fb3-81ee-593516773c8c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.119s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:18:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Deleted volume successfully.
Sep 10 17:18:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c687166-6a6a-4b00-88f3-1299693c11dd tempest-DeleteServersTestJSON-238631299 None] Lock "cinder-a2b314d2-03f3-4af5-9d8e-8fcb74a57410-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.167s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:18:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:18:10 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:18:10 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:18:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:18:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.510s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:19:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:05 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:19:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Flow 'volume_create_manager' (f7c0c205-12b8-4b73-8c6d-bde521dfcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:19:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c391993-04e2-4cfb-a465-af599490f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c391993-04e2-4cfb-a465-af599490f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-129586147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23853e-6735-4c77-9e3a-7313ce260a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe0a56e396d4d6c95bd52100e99130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:19:05Z,use_quota=True,user_id='a9bb9031e151417aa0e88730daaa5167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817c320-0d86-4de6-97cb-80c662dff426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0817c320-0d86-4de6-97cb-80c662dff426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c183fc0-7613-49e7-a24f-01f75818dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c183fc0-7613-49e7-a24f-01f75818dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed23853e-6735-4c77-9e3a-7313ce260a06', 'volume_name': 'volume-ed23853e-6735-4c77-9e3a-7313ce260a06', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc06d252-9586-4bb1-9049-2a35a4aca33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc06d252-9586-4bb1-9049-2a35a4aca33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a8b69-8924-450e-8d90-c6204abe1127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Volume ed23853e-6735-4c77-9e3a-7313ce260a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed23853e-6735-4c77-9e3a-7313ce260a06', 'volume_size': 1}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-129586147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23853e-6735-4c77-9e3a-7313ce260a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe0a56e396d4d6c95bd52100e99130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:19:05Z,use_quota=True,user_id='a9bb9031e151417aa0e88730daaa5167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Creating volume ed23853e-6735-4c77-9e3a-7313ce260a06 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:19:06 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:06 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=11, name=volume-ed23853e-6735-4c77-9e3a-7313ce260a06, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 1073741824" returned: 0 in 0.478s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06" returned: 0 in 0.120s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] <== create_volume: return (672ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060a8b69-8924-450e-8d90-c6204abe1127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed23853e-6735-4c77-9e3a-7313ce260a06', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc946b95-1c46-4e9a-9842-03bdaa891627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:19:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Volume volume-ed23853e-6735-4c77-9e3a-7313ce260a06 (ed23853e-6735-4c77-9e3a-7313ce260a06): created successfully
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc946b95-1c46-4e9a-9842-03bdaa891627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:19:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Flow 'volume_create_manager' (f7c0c205-12b8-4b73-8c6d-bde521dfcc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:19:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-93811d5b-324d-4d0e-a6d5-dd772ae84ca9 tempest-TaggedAttachmentsTest-938975430 None] Created volume successfully.
Sep 10 17:19:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-48986b4a-d50e-4cea-935b-43aca10fa495 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-48986b4a-d50e-4cea-935b-43aca10fa495 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-48986b4a-d50e-4cea-935b-43aca10fa495 tempest-TaggedBootDevicesTest-1271829778 None] Terminate volume connection completed successfully.
Sep 10 17:19:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-48986b4a-d50e-4cea-935b-43aca10fa495 tempest-TaggedBootDevicesTest-1271829778 None] Deleting attachment 34808f4d-325f-4651-9120-6f7f69f3ad0e. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:19:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-b6634860-359f-44d7-98fb-47de078bcd3d tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-b6634860-359f-44d7-98fb-47de078bcd3d tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-b6634860-359f-44d7-98fb-47de078bcd3d tempest-TaggedBootDevicesTest-1271829778 None] Terminate volume connection completed successfully.
Sep 10 17:19:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-b6634860-359f-44d7-98fb-47de078bcd3d tempest-TaggedBootDevicesTest-1271829778 None] Deleting attachment 9f3e6310-7cf1-41e2-9aa3-d8b20e1bbc62. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:19:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-bce7e02d-428c-4edf-aa2b-4f8e1881549e tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-bce7e02d-428c-4edf-aa2b-4f8e1881549e tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-bce7e02d-428c-4edf-aa2b-4f8e1881549e tempest-TaggedBootDevicesTest-1271829778 None] Terminate volume connection completed successfully.
Sep 10 17:19:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-4b901e2b-23d6-4642-8be3-96136305d4e8 req-bce7e02d-428c-4edf-aa2b-4f8e1881549e tempest-TaggedBootDevicesTest-1271829778 None] Deleting attachment b0841356-cc84-4106-9797-2fbdde091d12. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-f1597d53-7330-4831-954e-bb7ad2271d93-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-f1597d53-7330-4831-954e-bb7ad2271d93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-quobyte-f1597d53-7330-4831-954e-bb7ad2271d93" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-f1597d53-7330-4831-954e-bb7ad2271d93" acquired by "delete_volume" :: waited 0.040s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b4c106-aa62-46b2-a04a-b324377e190a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:19:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93" returned: 0 in 0.727s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f1597d53-7330-4831-954e-bb7ad2271d93" returned: 0 in 0.479s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-f1597d53-7330-4831-954e-bb7ad2271d93" released by "delete_volume" :: held 1.780s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:23 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Created reservations ['aa0f264f-c2c2-4ebe-ba78-315194729f84', '6d6738c8-4e4a-410e-aa3f-cdd64bee062f', 'ca786165-538c-4f27-8ee2-34cc1b678c6c', 'c3dd7484-d1da-44e9-9e48-c1632588b900'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.215s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:19:24 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Deleted volume successfully.
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fa5e6dcd-576d-458b-84fd-5aaa8202df35 tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-f1597d53-7330-4831-954e-bb7ad2271d93-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-a5ea18f1-bc87-4142-a8e1-9d0af363d683-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-a5ea18f1-bc87-4142-a8e1-9d0af363d683-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:25 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-quobyte-a5ea18f1-bc87-4142-a8e1-9d0af363d683" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-a5ea18f1-bc87-4142-a8e1-9d0af363d683" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:25 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e5567-777e-4ab5-8239-51d7ac349de3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:19:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683" returned: 0 in 0.709s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a5ea18f1-bc87-4142-a8e1-9d0af363d683" returned: 0 in 0.340s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-a5ea18f1-bc87-4142-a8e1-9d0af363d683" released by "delete_volume" :: held 1.353s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Created reservations ['4a1a0ad1-3946-4563-8f8f-04cdee8d11b8', 'c7ce3c62-d16a-42ad-bdb7-678493e1e2d8', '606af6e5-6ff1-4c8b-9fc9-2d892ae41280', 'd803d6d3-8f36-4b55-97f4-406acd4e53e5'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.287s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:19:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Deleted volume successfully.
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-18e3df21-85f9-4010-9896-0dd23a9134b1-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d51fa777-35ac-4aaa-a641-d1b2322f4a5c tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-a5ea18f1-bc87-4142-a8e1-9d0af363d683-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-18e3df21-85f9-4010-9896-0dd23a9134b1-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "cinder-quobyte-18e3df21-85f9-4010-9896-0dd23a9134b1" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-18e3df21-85f9-4010-9896-0dd23a9134b1" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16dc650-3a2b-4df6-8afa-27a2ffe8239a]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 0.406s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 1 in 0.633s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-18e3df21-85f9-4010-9896-0dd23a9134b1" returned: 0 in 0.115s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-quobyte-18e3df21-85f9-4010-9896-0dd23a9134b1" released by "delete_volume" :: held 1.448s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:29 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Created reservations ['a89dd023-a697-4342-98c0-6c128a07a9b8', '456af591-debe-4c02-8627-7ee094970c48', '47f4a4cb-a6eb-4100-a2e1-ac929d843943', '3ddc6362-08cc-43b1-9d42-620fc01ee8f8'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.109s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:19:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Deleted volume successfully.
Sep 10 17:19:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-24820d3e-6e28-464f-9e42-452fda7dff2b tempest-TaggedBootDevicesTest-1271829778 None] Lock "cinder-18e3df21-85f9-4010-9896-0dd23a9134b1-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:19:39 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=18,cinder:UPDATE=29,cinder:INSERT=7 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:19:40 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=20,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:19:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "cinder-b6cb9abd-f76b-43a7-8a83-eafad511ba97-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:19:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-b6cb9abd-f76b-43a7-8a83-eafad511ba97-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:20:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "cinder-quobyte-b6cb9abd-f76b-43a7-8a83-eafad511ba97" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:20:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-quobyte-b6cb9abd-f76b-43a7-8a83-eafad511ba97" acquired by "delete_volume" :: waited 0.037s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:00 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb084d7-0547-4bf0-9b32-c57e31a57d2d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:20:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:00 devstack quobyte-client[82918]: System call of process 88224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:20:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97" returned: 0 in 0.651s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b6cb9abd-f76b-43a7-8a83-eafad511ba97" returned: 0 in 0.429s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-quobyte-b6cb9abd-f76b-43a7-8a83-eafad511ba97" released by "delete_volume" :: held 1.413s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.436s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Created reservations ['2821e60d-d393-408c-bf36-82c9f81217b1', 'eaec7894-0f12-4681-83d5-b72d65d48c77', '39848a34-bc55-47e8-9ead-ab127c5ee4e6', 'f2af1814-5c38-486f-a290-cfbb4f25866e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.269s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:20:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Deleted volume successfully.
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "cinder-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-016b9903-7849-4876-be37-c5e8a11c48f1 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-b6cb9abd-f76b-43a7-8a83-eafad511ba97-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:03 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "cinder-quobyte-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-quobyte-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" acquired by "delete_volume" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9324c5f-a302-4720-b855-e4cc65f8d558]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" returned: 0 in 0.555s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" returned: 0 in 0.210s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-quobyte-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba" released by "delete_volume" :: held 0.957s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Created reservations ['5bf1a75a-062a-4f5e-bc4c-b729c89b5850', 'a92f26c3-6780-4c08-bd78-d1b8d3b9025d', 'a9336656-a29c-40ac-9282-4434f1ecf398', '4d468102-c3a3-4c0d-a170-056aa47fa6c6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.198s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:20:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Deleted volume successfully.
Sep 10 17:20:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73458cc8-ef2c-4183-b285-fcddd71fd047 tempest-AttachVolumeShelveTestJSON-1001509951 None] Lock "cinder-1791a8bd-9bf1-42ac-b2cf-b3b12f4f69ba-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:14 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=20,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:20:15 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:20:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:20:21 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:20:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Flow 'volume_create_manager' (4e7190b6-541c-4c10-8b56-5d0046b64149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:20:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f3a3b5-5b08-4d39-bd7e-a9e6d64e3cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f3a3b5-5b08-4d39-bd7e-a9e6d64e3cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1734718759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5e824c-b63a-40f7-b24c-c50df98ebe75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1791ad624d14688a8b1568ca4f9df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:20:22Z,use_quota=True,user_id='eea5079a738d482483cde848ed1c599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c7198c-58ba-454b-ae01-c1fb1fea868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c7198c-58ba-454b-ae01-c1fb1fea868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a70bc08-b092-4846-aaca-19cd6aa51f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a70bc08-b092-4846-aaca-19cd6aa51f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5e824c-b63a-40f7-b24c-c50df98ebe75', 'volume_name': 'volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a0236b-02d6-49e0-a768-5bbaa2b71b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a0236b-02d6-49e0-a768-5bbaa2b71b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2af8e3-98ec-4562-82ce-aa554f8e2e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:22 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Volume ed5e824c-b63a-40f7-b24c-c50df98ebe75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75', 'volume_size': 1}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1734718759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5e824c-b63a-40f7-b24c-c50df98ebe75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1791ad624d14688a8b1568ca4f9df88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:20:22Z,use_quota=True,user_id='eea5079a738d482483cde848ed1c599c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Creating volume ed5e824c-b63a-40f7-b24c-c50df98ebe75 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:20:22 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:22 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=12, name=volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 1073741824" returned: 0 in 0.478s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:20:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2af8e3-98ec-4562-82ce-aa554f8e2e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa137eb-7c22-4f90-96d0-49d2256af989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:20:23 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Volume volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 (ed5e824c-b63a-40f7-b24c-c50df98ebe75): created successfully
Sep 10 17:20:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa137eb-7c22-4f90-96d0-49d2256af989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:20:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Flow 'volume_create_manager' (4e7190b6-541c-4c10-8b56-5d0046b64149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:20:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-8aea0049-75b9-43a9-be2b-424ba62bff10 req-85f60834-e70b-48aa-8e4e-6b41d53b8931 tempest-VolumesGetTestJSON-257471198 None] Created volume successfully.
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Acquiring lock "cinder-ed5e824c-b63a-40f7-b24c-c50df98ebe75-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "cinder-ed5e824c-b63a-40f7-b24c-c50df98ebe75-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:25 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Acquiring lock "cinder-quobyte-ed5e824c-b63a-40f7-b24c-c50df98ebe75" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "cinder-quobyte-ed5e824c-b63a-40f7-b24c-c50df98ebe75" acquired by "delete_volume" :: waited 0.033s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e35daef-05da-46c6-8179-e88834c45647]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:20:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75" returned: 0 in 0.562s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed5e824c-b63a-40f7-b24c-c50df98ebe75" returned: 0 in 0.195s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "cinder-quobyte-ed5e824c-b63a-40f7-b24c-c50df98ebe75" released by "delete_volume" :: held 1.028s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:26 devstack cinder-volume[82884]: DEBUG cinder.quota [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Created reservations ['6556b792-7352-4204-8793-c82e1b2da7d8', 'd18b7508-8ca6-4446-a435-b64e54e16276', '357df825-ad99-4a44-9138-5eacc744a0bf', 'dcb44d2f-8f53-4f34-bd32-220f98368d61'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG cinder.manager [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:20:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Deleted volume successfully.
Sep 10 17:20:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-84bdf699-27d0-43aa-9be9-47e3c2fe5871 req-80f259bb-6584-4a40-ae34-abe0ca01289d tempest-VolumesGetTestJSON-257471198 None] Lock "cinder-ed5e824c-b63a-40f7-b24c-c50df98ebe75-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:20:37 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=13,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:20:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e3a1621d-98d6-4e1c-bcd6-c172163c74d8 tempest-BackendsCapabilitiesAdminTestsJSON-556239265 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82884) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 17:20:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a9cbd2b5-ecc4-4e9e-948a-fbe99342a999 tempest-BackendsCapabilitiesAdminTestsJSON-556239265 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144859313965, 'free_capacity_gb': 924.9144859313965, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82884) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 17:20:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 1.172s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:21:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Flow 'volume_create_manager' (8ec7a410-ed0f-4e1c-b028-5866ea381526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213f095a-d308-4f7e-bd70-f561fcf0d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213f095a-d308-4f7e-bd70-f561fcf0d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-123882443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d4eb51-3c72-420d-822f-544d8993ba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbc86c5366f48c2b8f9ffe33270042c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:01Z,use_quota=True,user_id='0d3fb20ea1b94906b96bd9b9d2cb8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45060774-0148-48f4-8c6a-0cdf3ecef460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45060774-0148-48f4-8c6a-0cdf3ecef460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6b8639-617e-4c90-9319-bc42c216ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6b8639-617e-4c90-9319-bc42c216ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d4eb51-3c72-420d-822f-544d8993ba11', 'volume_name': 'volume-60d4eb51-3c72-420d-822f-544d8993ba11', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2943616-7891-4009-bc84-62657b12c5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2943616-7891-4009-bc84-62657b12c5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb06aeb-2979-4eb1-9f28-ac0eb9d51d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:03 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Volume 60d4eb51-3c72-420d-822f-544d8993ba11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d4eb51-3c72-420d-822f-544d8993ba11', 'volume_size': 1}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-123882443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d4eb51-3c72-420d-822f-544d8993ba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fbc86c5366f48c2b8f9ffe33270042c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:01Z,use_quota=True,user_id='0d3fb20ea1b94906b96bd9b9d2cb8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Creating volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:21:03 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:21:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:03 devstack quobyte-client[82918]: System call of process 88450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:03 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=13, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 1073741824" returned: 0 in 0.860s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11" returned: 0 in 0.405s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] <== create_volume: return (1478ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:21:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb06aeb-2979-4eb1-9f28-ac0eb9d51d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d4eb51-3c72-420d-822f-544d8993ba11', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac80d1-b5cb-4e69-bcff-ad81b21336ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:05 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Volume volume-60d4eb51-3c72-420d-822f-544d8993ba11 (60d4eb51-3c72-420d-822f-544d8993ba11): created successfully
Sep 10 17:21:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac80d1-b5cb-4e69-bcff-ad81b21336ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Flow 'volume_create_manager' (8ec7a410-ed0f-4e1c-b028-5866ea381526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7263d14e-eaed-4911-8e61-308268fc695a tempest-SnapshotsActionsTest-1055598985 None] Created volume successfully.
Sep 10 17:21:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Creating offline snapshot 817ec56d-0770-4377-a3bc-582ccb10132f of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:21:07 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[875604da-782b-492a-81ae-411c52da9e89]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11" returned: 0 in 1.235s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:09 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=14, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f 1G" returned: 0 in 0.475s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:09 devstack quobyte-client[82918]: System call of process 88473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.379s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:21:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.146s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.180s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.info" returned: 0 in 0.200s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.info" returned: 0 in 0.126s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.658s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-93e7e8f2-7efb-4ecd-ac03-3511ee2e6d6a tempest-SnapshotsActionsTest-1055598985 None] Create snapshot completed successfully
Sep 10 17:21:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Creating offline snapshot 2cda4a40-ecf0-4b34-b2dd-fdf370732df2 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:21:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52161a-56cd-40d3-9f95-2f9aa130deac]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 1.060s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:15 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=16, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 1G" returned: 0 in 0.796s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:16 devstack quobyte-client[82918]: System call of process 88501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 0.558s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:21:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 0.315s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:21:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 0.678s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.489s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1daffe1e-d426-407c-95be-8468b84f94dc tempest-SnapshotsActionsTest-1055598985 None] Create snapshot completed successfully
Sep 10 17:21:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-2cda4a40-ecf0-4b34-b2dd-fdf370732df2-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-2cda4a40-ecf0-4b34-b2dd-fdf370732df2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.110s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-2cda4a40-ecf0-4b34-b2dd-fdf370732df2" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-2cda4a40-ecf0-4b34-b2dd-fdf370732df2" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Deleting offline snapshot 2cda4a40-ecf0-4b34-b2dd-fdf370732df2 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:21:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] snapshot_file for this snap is: volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:21:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa596ab-e6c3-4ad5-8e5e-bc596cb8b478]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:23 devstack quobyte-client[82918]: System call of process 88556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 2.348s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:23 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed0859-d0c3-485a-bdd6-d8de1235d4d5]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:25 devstack quobyte-client[82918]: System call of process 88573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 2.219s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:26 devstack quobyte-client[82918]: System call of process 88622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 1.929s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:29 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:21:29 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:21:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.2cda4a40-ecf0-4b34-b2dd-fdf370732df2" returned: 0 in 1.664s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-2cda4a40-ecf0-4b34-b2dd-fdf370732df2" released by "_delete_snapshot" :: held 9.452s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_snapshot" :: held 9.563s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:31 devstack cinder-volume[82884]: WARNING cinder.quota [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:21:31 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Created reservations ['00b61e62-595b-425a-8036-c09a84d05f7f', '4a28e0b0-0754-442e-afc8-464192ca24a9', 'c38a08b3-8ca3-4484-9770-99a3fda4fd34', '9ef86812-f30e-43da-a2a8-2253fc270ae3'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:21:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Delete snapshot completed successfully.
Sep 10 17:21:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1add887c-80f8-470a-9424-cc1c91405398 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-2cda4a40-ecf0-4b34-b2dd-fdf370732df2-delete_snapshot" released by "delete_snapshot" :: held 11.435s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Creating offline snapshot 6767b180-aa0e-48bd-b804-952c58ffb6f6 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:21:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d245bd-0e7b-491a-aeaf-cc157689a5d6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 1.857s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:39 devstack quobyte-client[82918]: System call of process 88723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:39 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=17, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 1G" returned: 0 in 1.227s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:39 devstack quobyte-client[82918]: System call of process 88728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.498s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.342s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.208s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.449s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-94862c1d-fbb8-47b8-a32e-2321b5eb6af9 tempest-SnapshotsActionsTest-1055598985 None] Create snapshot completed successfully
Sep 10 17:21:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-6767b180-aa0e-48bd-b804-952c58ffb6f6-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-6767b180-aa0e-48bd-b804-952c58ffb6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.176s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:42 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd37fb-bd4a-4523-a417-858d24c65ed1]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_snapshot" :: waited 0.410s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-6767b180-aa0e-48bd-b804-952c58ffb6f6" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-6767b180-aa0e-48bd-b804-952c58ffb6f6" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Deleting offline snapshot 6767b180-aa0e-48bd-b804-952c58ffb6f6 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] snapshot_file for this snap is: volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b106e99-109f-40b0-92fe-d1991c9bc59a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:43 devstack quobyte-client[82918]: System call of process 88753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06" returned: 0 in 0.895s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-ed23853e-6735-4c77-9e3a-7313ce260a06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ace4b744-848d-4889-ae6d-87ebb4ee0a48', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:21:44 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:44 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-7e050544-1951-4310-a72b-c478eaaa2942 req-a741a722-320e-41d6-8720-1f6b000b71b4 tempest-TaggedAttachmentsTest-938975430 None] attachment_update completed successfully.
Sep 10 17:21:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.949s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:44 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e5213-7ccf-458d-9ee7-c61a1e3dfa42]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:45 devstack quobyte-client[82918]: System call of process 88765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.878s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.582s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.6767b180-aa0e-48bd-b804-952c58ffb6f6" returned: 0 in 0.209s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-6767b180-aa0e-48bd-b804-952c58ffb6f6" released by "_delete_snapshot" :: held 3.067s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_snapshot" :: held 3.239s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:47 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Created reservations ['86a493c5-cff9-4492-b128-7cd9e20df3f1', '9fe5ad45-c96f-40ae-b4cc-ce394821be5a', '9061f340-b19e-4f0a-a283-3320f1c9a96f', 'a4a462ec-3a05-44b0-8a44-28b7288739ab'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:21:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Delete snapshot completed successfully.
Sep 10 17:21:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-62fe1580-aef8-4e0a-829b-207e60205b0f tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-6767b180-aa0e-48bd-b804-952c58ffb6f6-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:49 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Flow 'volume_create_manager' (6ed57b72-b109-4abd-ad35-ff034ba75999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb73410-3e92-4648-a85c-f53de24d51ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb73410-3e92-4648-a85c-f53de24d51ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-965743277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca5ec05-f7af-4891-9b3a-22acd10a614d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a7da76d2a499aa82feb2eea61ff60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:50Z,use_quota=True,user_id='40e41781284848888fe6206868e90cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10674b3-981f-4da2-85b3-544e2f3d11a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10674b3-981f-4da2-85b3-544e2f3d11a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c7ca11-d67a-4ab6-9568-03895bb470fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c7ca11-d67a-4ab6-9568-03895bb470fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca5ec05-f7af-4891-9b3a-22acd10a614d', 'volume_name': 'volume-eca5ec05-f7af-4891-9b3a-22acd10a614d', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7a5bdd-9d0d-47eb-86f3-03396e7d980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7a5bdd-9d0d-47eb-86f3-03396e7d980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498fb339-e3de-4b8f-827e-b3342dfa2976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Volume eca5ec05-f7af-4891-9b3a-22acd10a614d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca5ec05-f7af-4891-9b3a-22acd10a614d', 'volume_size': 1}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-965743277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca5ec05-f7af-4891-9b3a-22acd10a614d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a7da76d2a499aa82feb2eea61ff60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:50Z,use_quota=True,user_id='40e41781284848888fe6206868e90cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Creating volume eca5ec05-f7af-4891-9b3a-22acd10a614d {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:21:50 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:50 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=18, name=volume-eca5ec05-f7af-4891-9b3a-22acd10a614d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d 1073741824" returned: 0 in 0.629s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d" returned: 0 in 0.214s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Creating offline snapshot c723a795-d020-4942-bff9-d90310213515 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498fb339-e3de-4b8f-827e-b3342dfa2976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca5ec05-f7af-4891-9b3a-22acd10a614d', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55267575-a12f-44e4-8857-08d5f71ece61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd838ac-e4f3-44f4-a0ea-c47867dc3305]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Volume volume-eca5ec05-f7af-4891-9b3a-22acd10a614d (eca5ec05-f7af-4891-9b3a-22acd10a614d): created successfully
Sep 10 17:21:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55267575-a12f-44e4-8857-08d5f71ece61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Flow 'volume_create_manager' (6ed57b72-b109-4abd-ad35-ff034ba75999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4f61cf67-d074-4f86-8245-d92c2ceef5c2 tempest-ServersNegativeTestJSON-1192176622 None] Created volume successfully.
Sep 10 17:21:52 devstack quobyte-client[82918]: System call of process 89169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 1.050s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:53 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=19, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 1G" returned: 0 in 0.644s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:53 devstack quobyte-client[82918]: System call of process 89183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.318s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:21:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.171s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:21:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.130s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9e0b9622-f7df-4e6e-861b-f267d2359ed4 tempest-SnapshotsActionsTest-1055598985 None] Create snapshot completed successfully
Sep 10 17:21:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Flow 'volume_create_manager' (41e00fce-5a9e-4659-8410-e0560c8e53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2834059-ba08-4f1c-a9a0-f9c20f99d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2834059-ba08-4f1c-a9a0-f9c20f99d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1090469483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203c385d-9214-49c6-98f0-88df11f7394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a7da76d2a499aa82feb2eea61ff60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:55Z,use_quota=True,user_id='40e41781284848888fe6206868e90cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c699634-24c4-454c-967d-868164ba2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c699634-24c4-454c-967d-868164ba2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0829f32-a9d1-4c94-be70-64cd0b75984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0829f32-a9d1-4c94-be70-64cd0b75984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203c385d-9214-49c6-98f0-88df11f7394f', 'volume_name': 'volume-203c385d-9214-49c6-98f0-88df11f7394f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb8800d-bae7-491a-ad6b-8ab454ba3ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb8800d-bae7-491a-ad6b-8ab454ba3ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23a8e29-2aeb-46aa-a4f0-c2255462becc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:55 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Volume 203c385d-9214-49c6-98f0-88df11f7394f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203c385d-9214-49c6-98f0-88df11f7394f', 'volume_size': 1}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1090469483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203c385d-9214-49c6-98f0-88df11f7394f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3a7da76d2a499aa82feb2eea61ff60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:21:55Z,use_quota=True,user_id='40e41781284848888fe6206868e90cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Creating volume 203c385d-9214-49c6-98f0-88df11f7394f {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:21:55 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:21:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:55 devstack quobyte-client[82918]: System call of process 89194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:55 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=20, name=volume-203c385d-9214-49c6-98f0-88df11f7394f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-c723a795-d020-4942-bff9-d90310213515-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f 1073741824" returned: 0 in 0.898s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-c723a795-d020-4942-bff9-d90310213515-delete_snapshot" acquired by "delete_snapshot" :: waited 0.347s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f" returned: 0 in 0.346s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] <== create_volume: return (1281ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_snapshot" :: waited 0.141s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-c723a795-d020-4942-bff9-d90310213515" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-c723a795-d020-4942-bff9-d90310213515" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Deleting offline snapshot c723a795-d020-4942-bff9-d90310213515 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] snapshot_file for this snap is: volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23a8e29-2aeb-46aa-a4f0-c2255462becc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203c385d-9214-49c6-98f0-88df11f7394f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1564d76f-3f35-4ad9-bfb1-376a14b1e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9072407e-4bb7-46b2-9d8f-7122e9131d53]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Volume volume-203c385d-9214-49c6-98f0-88df11f7394f (203c385d-9214-49c6-98f0-88df11f7394f): created successfully
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1564d76f-3f35-4ad9-bfb1-376a14b1e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Flow 'volume_create_manager' (41e00fce-5a9e-4659-8410-e0560c8e53dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:21:57 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5a5cd2cc-5507-4ae9-9562-bf376b2a39bc tempest-ServersNegativeTestJSON-1192176622 None] Created volume successfully.
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.670s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a4983a-6bd5-4d3f-ae55-4813bfb18de1]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:58 devstack quobyte-client[82918]: System call of process 89212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.497s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:58 devstack quobyte-client[82918]: System call of process 89215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.345s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.c723a795-d020-4942-bff9-d90310213515" returned: 0 in 0.160s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-c723a795-d020-4942-bff9-d90310213515" released by "_delete_snapshot" :: held 2.146s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_snapshot" :: held 2.217s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "cinder-203c385d-9214-49c6-98f0-88df11f7394f-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-203c385d-9214-49c6-98f0-88df11f7394f-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Created reservations ['07032ece-0f37-4aa6-83a5-40acc2042070', '3a317327-7306-425f-81d1-5e35119136e9', 'de0f2e00-814f-4d72-a36d-88e909cc468a', 'b2187ef9-26ab-4773-9233-09153fd7998d'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:21:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "cinder-quobyte-203c385d-9214-49c6-98f0-88df11f7394f" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-quobyte-203c385d-9214-49c6-98f0-88df11f7394f" acquired by "delete_volume" :: waited 0.095s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:21:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Delete snapshot completed successfully.
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-208cc6b3-bf56-4058-82f9-dd6c977fa939 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-c723a795-d020-4942-bff9-d90310213515-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607e328-8fa1-4a63-bbd7-95d8ac099d9f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:21:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f" returned: 0 in 0.518s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-203c385d-9214-49c6-98f0-88df11f7394f" returned: 0 in 0.136s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-quobyte-203c385d-9214-49c6-98f0-88df11f7394f" released by "delete_volume" :: held 0.872s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:00 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Created reservations ['cc20d8f2-67f6-4064-b2b8-2d388ba13d04', '6fff22d4-b206-4d13-a0e7-453960e037e1', 'bc7b2812-2522-4621-9416-716789e79135', 'c569e009-f44a-4800-b515-5ab918cdb6e9'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.307s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.603s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "cinder-eca5ec05-f7af-4891-9b3a-22acd10a614d-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Creating offline snapshot 953be277-3a6b-4cbe-83e6-6afb7a27ece8 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e14adc-fd33-40f3-a090-3ecf501e9ae2]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-eca5ec05-f7af-4891-9b3a-22acd10a614d-delete_volume" acquired by "delete_volume" :: waited 0.450s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Deleted volume successfully.
Sep 10 17:22:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "cinder-quobyte-eca5ec05-f7af-4891-9b3a-22acd10a614d" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-efbd73a2-9750-447c-94b9-4806ddfa2a40 tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-203c385d-9214-49c6-98f0-88df11f7394f-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.641s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-quobyte-eca5ec05-f7af-4891-9b3a-22acd10a614d" acquired by "delete_volume" :: waited 0.244s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f9b5c-fad0-4314-b3e0-a933cdfc87ec]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:03 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=21, name=volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 1G" returned: 0 in 0.554s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img rebase -u -b volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.241s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d" returned: 0 in 0.688s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.221s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eca5ec05-f7af-4891-9b3a-22acd10a614d" returned: 0 in 0.164s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.170s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-quobyte-eca5ec05-f7af-4891-9b3a-22acd10a614d" released by "delete_volume" :: held 1.281s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b6a48d61-d3ed-463d-b8a4-3d06a6cdc3f8 tempest-SnapshotsActionsTest-1055598985 None] Create snapshot completed successfully
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Created reservations ['43405d48-3bb5-4bb6-a5ff-bdc881ed2ef7', '6ee0659b-959c-481a-81dd-5783e593c327', 'cd5650ad-ce29-45cf-b42b-d9b4a7c75a2a', 'cc8c9fab-2467-432d-b3c2-edb18c0e41f4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-953be277-3a6b-4cbe-83e6-6afb7a27ece8-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-953be277-3a6b-4cbe-83e6-6afb7a27ece8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.341s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Deleted volume successfully.
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_snapshot" :: waited 0.149s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Acquiring lock "cinder-quobyte-953be277-3a6b-4cbe-83e6-6afb7a27ece8" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-65c56dc2-04de-46ac-864b-f64052f9337d tempest-ServersNegativeTestJSON-1192176622 None] Lock "cinder-eca5ec05-f7af-4891-9b3a-22acd10a614d-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-953be277-3a6b-4cbe-83e6-6afb7a27ece8" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Deleting offline snapshot 953be277-3a6b-4cbe-83e6-6afb7a27ece8 of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] snapshot_file for this snap is: volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f16f86-6b28-4a0e-974c-cf2cb31d4294]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:05 devstack quobyte-client[82918]: System call of process 89249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:22:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.723s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[25585244-c81f-45eb-97e0-e18dd9e9533f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.599s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:22:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.493s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.953be277-3a6b-4cbe-83e6-6afb7a27ece8" returned: 0 in 0.460s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-953be277-3a6b-4cbe-83e6-6afb7a27ece8" released by "_delete_snapshot" :: held 2.923s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_snapshot" :: held 2.995s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:08 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Created reservations ['d2d0d20e-c008-4a2d-9c12-c1f9dd024ffe', 'c8ada942-2198-4d66-9869-0b74ef80936d', '7c2566b9-7902-4c4d-9e10-21328c22901d', 'b962573d-18c7-41b2-a81e-409b52fa3c6c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Delete snapshot completed successfully.
Sep 10 17:22:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4032b9-cc69-4d7c-81b5-86f5d8954a14 tempest-SnapshotsActionsTest-1387399307 None] Lock "cinder-953be277-3a6b-4cbe-83e6-6afb7a27ece8-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "cinder-817ec56d-0770-4377-a3bc-582ccb10132f-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-817ec56d-0770-4377-a3bc-582ccb10132f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "cinder-quobyte-817ec56d-0770-4377-a3bc-582ccb10132f" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-817ec56d-0770-4377-a3bc-582ccb10132f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Deleting offline snapshot 817ec56d-0770-4377-a3bc-582ccb10132f of volume 60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] snapshot_file for this snap is: volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8007cdf-1b2f-472f-b7c9-ae6b8040a073]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.448s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60d4eb51-3c72-420d-822f-544d8993ba11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ccdc7-1cd6-4dc2-b683-e8072703c3ea]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11" returned: 0 in 0.440s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.208s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11.817ec56d-0770-4377-a3bc-582ccb10132f" returned: 0 in 0.083s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-817ec56d-0770-4377-a3bc-582ccb10132f" released by "_delete_snapshot" :: held 1.486s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_snapshot" :: held 1.517s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Created reservations ['7281bba8-3217-41dd-a1f1-5074bf16b83e', 'e899d27a-933b-40a3-a5c0-026da655c190', 'bcc881f8-33cb-48ad-b511-b5e3c16c2a53', 'a5862366-2038-4ac0-b613-5bafd294528f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Delete snapshot completed successfully.
Sep 10 17:22:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3fbc343a-cd98-4dfe-bb66-cda667c107c4 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-817ec56d-0770-4377-a3bc-582ccb10132f-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "cinder-60d4eb51-3c72-420d-822f-544d8993ba11-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-60d4eb51-3c72-420d-822f-544d8993ba11-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:12 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e236c-c5a2-410a-8d94-9eaf7b8ef9ed]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11" returned: 0 in 0.424s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-60d4eb51-3c72-420d-822f-544d8993ba11" returned: 0 in 0.158s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-quobyte-60d4eb51-3c72-420d-822f-544d8993ba11" released by "delete_volume" :: held 0.789s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Created reservations ['82678658-24a9-4fe8-871b-06b5bb30570b', '670cda07-a2d5-4f0a-9740-a6ec3f1a2e0c', 'b0eabb88-673b-4837-a287-97c58e9e4c8c', '465fa03b-62f2-4a66-8020-c4a3c78d3d0e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.091s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:13 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Deleted volume successfully.
Sep 10 17:22:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e6844ae5-b8cb-4df7-8b7c-964628197839 tempest-SnapshotsActionsTest-1055598985 None] Lock "cinder-60d4eb51-3c72-420d-822f-544d8993ba11-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-87c3cb8e-114e-4145-96d0-e5075c3a6799 req-28b0f404-982e-4736-8815-1d62b79d6a59 tempest-TaggedAttachmentsTest-938975430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-87c3cb8e-114e-4145-96d0-e5075c3a6799 req-28b0f404-982e-4736-8815-1d62b79d6a59 tempest-TaggedAttachmentsTest-938975430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-87c3cb8e-114e-4145-96d0-e5075c3a6799 req-28b0f404-982e-4736-8815-1d62b79d6a59 tempest-TaggedAttachmentsTest-938975430 None] Terminate volume connection completed successfully.
Sep 10 17:22:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-87c3cb8e-114e-4145-96d0-e5075c3a6799 req-28b0f404-982e-4736-8815-1d62b79d6a59 tempest-TaggedAttachmentsTest-938975430 None] Deleting attachment ace4b744-848d-4889-ae6d-87ebb4ee0a48. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:22:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:27 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:22:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Flow 'volume_create_manager' (1703733e-1fb5-484c-9d97-e3b05291c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61ea2f4-9663-4d82-a54c-85640212fa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61ea2f4-9663-4d82-a54c-85640212fa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204442382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13c65a8-21db-4091-ae91-9f9986d237b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d087e82f25604a7d86dfc7f9c5122c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:28Z,use_quota=True,user_id='5346c26a7bfa416695798ee8c9016875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcdaa7d-052f-460a-8d5c-4f82e45b48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcdaa7d-052f-460a-8d5c-4f82e45b48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b4c0e3-56cb-4aa7-9a60-818e6fa83409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b4c0e3-56cb-4aa7-9a60-818e6fa83409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13c65a8-21db-4091-ae91-9f9986d237b7', 'volume_name': 'volume-c13c65a8-21db-4091-ae91-9f9986d237b7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb5140-7147-43ae-91a5-5b8f715802a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb5140-7147-43ae-91a5-5b8f715802a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be72da46-4165-4f48-b59d-fa984fd12d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume c13c65a8-21db-4091-ae91-9f9986d237b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13c65a8-21db-4091-ae91-9f9986d237b7', 'volume_size': 1}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204442382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13c65a8-21db-4091-ae91-9f9986d237b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d087e82f25604a7d86dfc7f9c5122c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:28Z,use_quota=True,user_id='5346c26a7bfa416695798ee8c9016875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Creating volume c13c65a8-21db-4091-ae91-9f9986d237b7 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:22:28 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:28 devstack quobyte-client[82918]: System call of process 89377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=47,cinder:INSERT=9,cinder:UPDATE=63,cinder:DELETE=3 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:22:28 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=22, name=volume-c13c65a8-21db-4091-ae91-9f9986d237b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7 1073741824" returned: 0 in 0.446s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] <== create_volume: return (591ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.603s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be72da46-4165-4f48-b59d-fa984fd12d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13c65a8-21db-4091-ae91-9f9986d237b7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dfbf46-1746-4162-a112-ecfa84759c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume volume-c13c65a8-21db-4091-ae91-9f9986d237b7 (c13c65a8-21db-4091-ae91-9f9986d237b7): created successfully
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6dfbf46-1746-4162-a112-ecfa84759c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Flow 'volume_create_manager' (1703733e-1fb5-484c-9d97-e3b05291c947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c3af8956-312f-4d53-9afc-72cc5551260f tempest-VolumeQuotasAdminTestJSON-686859231 None] Created volume successfully.
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "cinder-c13c65a8-21db-4091-ae91-9f9986d237b7-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "cinder-c13c65a8-21db-4091-ae91-9f9986d237b7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "cinder-quobyte-c13c65a8-21db-4091-ae91-9f9986d237b7" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "cinder-quobyte-c13c65a8-21db-4091-ae91-9f9986d237b7" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[85691c2e-2dec-467e-8dfc-0a964c26d7a0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7" returned: 0 in 0.528s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-c13c65a8-21db-4091-ae91-9f9986d237b7" returned: 0 in 0.110s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "cinder-quobyte-c13c65a8-21db-4091-ae91-9f9986d237b7" released by "delete_volume" :: held 0.802s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=59,cinder:INSERT=23,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Created reservations ['c269c403-f8ae-4ab9-a2de-fa589335d215', '7c0ec92b-e70c-43d6-9a6d-48acb1bb6477', 'd0f5511a-00e4-499e-8733-90a311d3b40a', '90e5f7f2-cc1a-475d-9b10-46c79e3b71a3'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:32 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Deleted volume successfully.
Sep 10 17:22:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7217b7cf-d6cc-4ff7-a816-92a7f5fcf99d tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "cinder-c13c65a8-21db-4091-ae91-9f9986d237b7-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:33 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Flow 'volume_create_manager' (06cb0e3d-defa-4e14-a916-3e1983dae77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bafb15e-94cd-40d2-a65a-ac1e601bc694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bafb15e-94cd-40d2-a65a-ac1e601bc694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1686675699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd76a3-35d6-4231-ac70-04ebb3d3dac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d087e82f25604a7d86dfc7f9c5122c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:33Z,use_quota=True,user_id='5346c26a7bfa416695798ee8c9016875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b644f4da-9cfe-4332-9de8-bdb801491744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b644f4da-9cfe-4332-9de8-bdb801491744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091ecc51-ca71-4156-9e52-df6accaa9b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091ecc51-ca71-4156-9e52-df6accaa9b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcd76a3-35d6-4231-ac70-04ebb3d3dac5', 'volume_name': 'volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d917fb-b0cf-4495-a20c-14db939528e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d917fb-b0cf-4495-a20c-14db939528e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73f3154-cead-4489-85da-4254ccd4201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:33 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume 4fcd76a3-35d6-4231-ac70-04ebb3d3dac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5', 'volume_size': 1}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1686675699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd76a3-35d6-4231-ac70-04ebb3d3dac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d087e82f25604a7d86dfc7f9c5122c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:33Z,use_quota=True,user_id='5346c26a7bfa416695798ee8c9016875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Creating volume 4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:22:33 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:22:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:33 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=23, name=volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 1073741824" returned: 0 in 0.368s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" returned: 0 in 0.162s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.622s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73f3154-cead-4489-85da-4254ccd4201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ca6b5-de33-4441-88dd-ae25e6a2cbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:34 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Volume volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 (4fcd76a3-35d6-4231-ac70-04ebb3d3dac5): created successfully
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ca6b5-de33-4441-88dd-ae25e6a2cbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:34 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Flow 'volume_create_manager' (06cb0e3d-defa-4e14-a916-3e1983dae77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-093056c7-690a-4c01-bcb3-079ef780a12b tempest-VolumeQuotasAdminTestJSON-686859231 None] Created volume successfully.
Sep 10 17:22:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0a6c6d9b-a973-4fde-9628-0befcbe95fbe tempest-VolumeQuotasAdminTestJSON-1246031091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:36 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0a6c6d9b-a973-4fde-9628-0befcbe95fbe tempest-VolumeQuotasAdminTestJSON-1246031091 None] Transfer volume completed successfully.
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Acquiring lock "cinder-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "cinder-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Acquiring lock "cinder-quobyte-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "cinder-quobyte-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" acquired by "delete_volume" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79708f9-7ddd-4f89-ac7d-0601304336dd]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:22:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" returned: 0 in 0.608s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" returned: 0 in 0.112s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "cinder-quobyte-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5" released by "delete_volume" :: held 0.893s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:39 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Created reservations ['45d5a174-ec96-4efa-880e-5c3e8a52cdce', '410cfcca-c109-40e6-9b9a-727adb6019c8', '316910f8-112a-4681-8a79-2a24ae3d0e36', '5beaafcf-a866-45a1-905f-b1bc449501bd'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.138s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:22:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Deleted volume successfully.
Sep 10 17:22:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-055b722e-dd67-41e6-98da-e595f43e6e78 tempest-VolumeQuotasAdminTestJSON-895012509 None] Lock "cinder-4fcd76a3-35d6-4231-ac70-04ebb3d3dac5-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:22:49 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=11,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:22:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=10,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:22:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Flow 'volume_create_manager' (eb36315a-1097-4719-a067-4a57a1e5c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b0a79a-5a74-467f-8e97-c7f365a4f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b0a79a-5a74-467f-8e97-c7f365a4f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2023824820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c211b81-fe83-42b6-9aa2-bdae1d9d8f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c582346c767f4b5f93cb243ae4c83d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:56Z,use_quota=True,user_id='37200dfc51a54ea1a62e4bd116a758ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52bdc0a7-d23b-460c-9699-3ac3757068d5),volume_type_id=52bdc0a7-d23b-460c-9699-3ac3757068d5)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58a243d-25b0-4dfd-9cd7-63778166abda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58a243d-25b0-4dfd-9cd7-63778166abda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e5c4b-7e72-41f7-b3cb-f5dd8ae4bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28e5c4b-7e72-41f7-b3cb-f5dd8ae4bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c211b81-fe83-42b6-9aa2-bdae1d9d8f41', 'volume_name': 'volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cfc1f4-a708-4830-9ee1-e11e5a23f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cfc1f4-a708-4830-9ee1-e11e5a23f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e4efb7-331a-424d-bd88-01c4ac6f2f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume 6c211b81-fe83-42b6-9aa2-bdae1d9d8f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41', 'volume_size': 1}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2023824820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c211b81-fe83-42b6-9aa2-bdae1d9d8f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c582346c767f4b5f93cb243ae4c83d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:22:56Z,use_quota=True,user_id='37200dfc51a54ea1a62e4bd116a758ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52bdc0a7-d23b-460c-9699-3ac3757068d5),volume_type_id=52bdc0a7-d23b-460c-9699-3ac3757068d5)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Creating volume 6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:22:57 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:57 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=24, name=volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 1073741824" returned: 0 in 0.617s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" returned: 0 in 0.350s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] <== create_volume: return (1146ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e4efb7-331a-424d-bd88-01c4ac6f2f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcdac80-d47a-47da-a4bf-a5056c7e4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:22:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 (6c211b81-fe83-42b6-9aa2-bdae1d9d8f41): created successfully
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcdac80-d47a-47da-a4bf-a5056c7e4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:22:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Flow 'volume_create_manager' (eb36315a-1097-4719-a067-4a57a1e5c475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:22:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7da9a373-1c0c-4b5d-8345-4b0cf69b8d24 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Created volume successfully.
Sep 10 17:22:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:22:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.103s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:00 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:23:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-35831435-8258-4a65-ae8f-0a1b1d20159b tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Retype volume completed successfully.
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "cinder-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "cinder-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "cinder-quobyte-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "cinder-quobyte-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" acquired by "delete_volume" :: waited 0.343s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.384s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89147ca-0ba7-467d-ba84-7d44db8a02c8]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:02 devstack quobyte-client[82918]: System call of process 89489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:23:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" returned: 0 in 0.704s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" returned: 0 in 0.177s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "cinder-quobyte-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41" released by "delete_volume" :: held 1.211s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:03 devstack cinder-volume[82884]: WARNING cinder.quota [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:23:03 devstack cinder-volume[82884]: WARNING cinder.quota [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Created reservations ['a83f127d-5017-48e2-9bc5-60c1947e8bec', '0df32b39-4b46-4f15-be95-fff9397fabf5', '695dbf7a-d735-43f3-b2cd-1126721665ac', 'c5b8964d-3cc8-4f8f-93b0-28f29550d607'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.268s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:23:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Deleted volume successfully.
Sep 10 17:23:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3ea2d6af-3eff-4849-b52b-b744cd70fc48 tempest-VolumeRetypeWithoutMigrationTest-1910762945 None] Lock "cinder-6c211b81-fe83-42b6-9aa2-bdae1d9d8f41-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "cinder-ed23853e-6735-4c77-9e3a-7313ce260a06-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "cinder-ed23853e-6735-4c77-9e3a-7313ce260a06-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:08 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "cinder-quobyte-ed23853e-6735-4c77-9e3a-7313ce260a06" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "cinder-quobyte-ed23853e-6735-4c77-9e3a-7313ce260a06" acquired by "delete_volume" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[102ef6f5-fd6b-480a-8738-52e24fc82e87]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:09 devstack quobyte-client[82918]: System call of process 89512 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:23:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06" returned: 0 in 0.608s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ed23853e-6735-4c77-9e3a-7313ce260a06" returned: 0 in 0.127s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "cinder-quobyte-ed23853e-6735-4c77-9e3a-7313ce260a06" released by "delete_volume" :: held 0.941s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Created reservations ['345d5eac-1d62-4099-aaba-f4e6a74390c7', 'f80d36a9-1c7a-41f0-8aed-6d1940e1b48c', 'f011be06-961c-42bb-b1dd-5faf3a5781ac', '2edfd756-6f69-4083-a55a-6db3f9ff7aa4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.103s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:23:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Deleted volume successfully.
Sep 10 17:23:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7d408cfc-0088-44c3-8bfb-664a678299e5 tempest-TaggedAttachmentsTest-938975430 None] Lock "cinder-ed23853e-6735-4c77-9e3a-7313ce260a06-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:17 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Flow 'volume_create_manager' (de931675-5af3-4749-a4d8-d48824e381a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cfa8c9-3687-4d71-abae-bf8b46697c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cfa8c9-3687-4d71-abae-bf8b46697c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-132638815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d2a2bd-ec53-469f-9255-86365f3816a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac294dbbc004bacbeb4ce6a901be601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:23:17Z,use_quota=True,user_id='66bebaf97bfe4906a8ceaf31dc178dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b3762db-bb6d-4730-b685-a2ca8a80e05d),volume_type_id=2b3762db-bb6d-4730-b685-a2ca8a80e05d)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3a277-0526-48dd-89c6-8327a76c4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3a277-0526-48dd-89c6-8327a76c4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051cfd9-2369-43f4-a8fd-6abc7924aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2051cfd9-2369-43f4-a8fd-6abc7924aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d2a2bd-ec53-469f-9255-86365f3816a1', 'volume_name': 'volume-75d2a2bd-ec53-469f-9255-86365f3816a1', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdecdef-a8a5-4eed-8aa6-601797425008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdecdef-a8a5-4eed-8aa6-601797425008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b16451-6aba-4626-b936-9029ef6db7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Volume 75d2a2bd-ec53-469f-9255-86365f3816a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d2a2bd-ec53-469f-9255-86365f3816a1', 'volume_size': 1}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-132638815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d2a2bd-ec53-469f-9255-86365f3816a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac294dbbc004bacbeb4ce6a901be601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:23:17Z,use_quota=True,user_id='66bebaf97bfe4906a8ceaf31dc178dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b3762db-bb6d-4730-b685-a2ca8a80e05d),volume_type_id=2b3762db-bb6d-4730-b685-a2ca8a80e05d)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Creating volume 75d2a2bd-ec53-469f-9255-86365f3816a1 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:23:18 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:23:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=25, name=volume-75d2a2bd-ec53-469f-9255-86365f3816a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1 1073741824" returned: 0 in 1.300s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1" returned: 0 in 0.298s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] <== create_volume: return (1791ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b16451-6aba-4626-b936-9029ef6db7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d2a2bd-ec53-469f-9255-86365f3816a1', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cff558-66f2-4103-8619-9aeafce9e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:21 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Volume volume-75d2a2bd-ec53-469f-9255-86365f3816a1 (75d2a2bd-ec53-469f-9255-86365f3816a1): created successfully
Sep 10 17:23:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cff558-66f2-4103-8619-9aeafce9e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Flow 'volume_create_manager' (de931675-5af3-4749-a4d8-d48824e381a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:23:21 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9ffaaa0a-8dd9-4cc1-b2d4-c9fe485c1e8c tempest-VolumeTypesAccessTest-289305375 None] Created volume successfully.
Sep 10 17:23:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Acquiring lock "cinder-75d2a2bd-ec53-469f-9255-86365f3816a1-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "cinder-75d2a2bd-ec53-469f-9255-86365f3816a1-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:24 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Acquiring lock "cinder-quobyte-75d2a2bd-ec53-469f-9255-86365f3816a1" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "cinder-quobyte-75d2a2bd-ec53-469f-9255-86365f3816a1" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b46f3-642f-4b88-978f-def10b9bb21b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1" returned: 0 in 1.239s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-75d2a2bd-ec53-469f-9255-86365f3816a1" returned: 0 in 0.335s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "cinder-quobyte-75d2a2bd-ec53-469f-9255-86365f3816a1" released by "delete_volume" :: held 2.342s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:27 devstack cinder-volume[82884]: WARNING cinder.quota [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-551967502 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-551967502, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:23:27 devstack cinder-volume[82884]: WARNING cinder.quota [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-551967502 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-551967502, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Created reservations ['810912dc-8470-4316-b617-27b624d73e80', 'dc1a370e-9f69-4225-8c0f-4465456759d5', 'c7b9f274-1c02-4964-9f25-9c5017dbba9e', '95c821e4-8ba7-4fc7-bb64-e8b9b6663658'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.217s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:28 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:23:28 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Deleted volume successfully.
Sep 10 17:23:29 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8de5c8f0-31ce-4e31-88a2-e6e59ef3730e tempest-VolumeTypesAccessTest-289305375 None] Lock "cinder-75d2a2bd-ec53-469f-9255-86365f3816a1-delete_volume" released by "delete_volume" :: held 5.398s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:23:37 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=22,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:23:38 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=33,cinder:SELECT=26,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:23:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-823d1136-12ea-4a3d-b9da-cf9f8e3a46c9 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-823d1136-12ea-4a3d-b9da-cf9f8e3a46c9 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-161868806: creating
Sep 10 17:23:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-823d1136-12ea-4a3d-b9da-cf9f8e3a46c9 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-161868806: created successfully
Sep 10 17:23:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-823d1136-12ea-4a3d-b9da-cf9f8e3a46c9 tempest-GroupSnapshotsTest-290551935 None] Create group completed successfully.
Sep 10 17:23:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:49 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:23:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (fb40f110-2893-480f-babb-761443a934c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223259b-1d02-410b-88f1-dd188401c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223259b-1d02-410b-88f1-dd188401c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1542381799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1607d908-d6be-4e3c-93ec-6e2966388531,host='devstack@QuobyteHD#QuobyteHD',id=3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:23:50Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff0979ec-dec5-4ed9-90ea-1859bd84d7a3),volume_type_id=ff0979ec-dec5-4ed9-90ea-1859bd84d7a3)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa6c3e-0077-429e-bb79-b21d856c558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa6c3e-0077-429e-bb79-b21d856c558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945da17a-5d10-4464-b5ba-96b5dc5938af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (945da17a-5d10-4464-b5ba-96b5dc5938af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e', 'volume_name': 'volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45dbab-de7b-44ce-999b-17eefd035286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45dbab-de7b-44ce-999b-17eefd035286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19e4c95-2b65-4e78-8f02-95ae1fccb913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Volume 3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e', 'volume_size': 1}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1607d908-d6be-4e3c-93ec-6e2966388531,created_at=2025-09-10T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1542381799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1607d908-d6be-4e3c-93ec-6e2966388531,host='devstack@QuobyteHD#QuobyteHD',id=3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:23:50Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff0979ec-dec5-4ed9-90ea-1859bd84d7a3),volume_type_id=ff0979ec-dec5-4ed9-90ea-1859bd84d7a3)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Creating volume 3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:23:50 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:50 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=26, name=volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e 1073741824" returned: 0 in 0.508s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.183s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:23:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19e4c95-2b65-4e78-8f02-95ae1fccb913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d597448c-b769-4604-8121-d404bace097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:23:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Volume volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e (3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e): created successfully
Sep 10 17:23:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d597448c-b769-4604-8121-d404bace097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:23:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (fb40f110-2893-480f-babb-761443a934c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:23:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-93f21db2-f2a3-4edb-b6f5-1093ddd879c9 tempest-GroupSnapshotsTest-290551935 None] Created volume successfully.
Sep 10 17:23:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] GroupSnapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: creating.
Sep 10 17:23:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Group snapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: creating. {{(pid=82884) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Creating offline snapshot 79f71067-6c73-46d8-b821-6056e58232cc of volume 3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f44c49-2d4e-4ca1-8394-8d861d08fcc1]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:53 devstack quobyte-client[82918]: System call of process 89664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.694s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:54 devstack quobyte-client[82918]: System call of process 89672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:23:54 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=27, name=volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc 1G" returned: 0 in 0.366s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img rebase -u -b volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.245s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.106s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.090s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.info" returned: 0 in 0.132s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:23:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.info" returned: 0 in 0.238s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:55 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7920d39b-b54b-4954-a8c0-278c9ba151bd tempest-GroupSnapshotsTest-290551935 None] group_snapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: created successfully
Sep 10 17:23:57 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:23:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc-31828c40-43f4-42ab-9a51-1e901dc996c0" by "_create_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc-31828c40-43f4-42ab-9a51-1e901dc996c0" acquired by "_create_volume_from_snapshot" :: waited 0.100s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Creating volume 31828c40-43f4-42ab-9a51-1e901dc996c0 from snapshot 79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" by "_copy_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] snapshot: 79f71067-6c73-46d8-b821-6056e58232cc, volume: 31828c40-43f4-42ab-9a51-1e901dc996c0,  {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[43689f89-4e43-43bf-b12c-fa81c09edd5b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.623s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Creating direct copy from snapshot {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0603ad-ef22-4542-9c34-9a450abc918f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:23:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:23:59 devstack quobyte-client[82918]: System call of process 89714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:23:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.713s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:23:59 devstack cinder-volume[82884]: DEBUG cinder.utils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 not found in is_blk_device check {{(pid=82884) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 17:23:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:00 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=29, name=volume-31828c40-43f4-42ab-9a51-1e901dc996c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.127s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.474s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:24:07 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:24:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0" returned: 0 in 9.327s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d3de3-e5ef-4ed1-b480-c52f135483f0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.642s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:24:09 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Converted 1024.00 MB image at 109.73 MB/s
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0" returned: 0 in 0.137s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" released by "_copy_volume_from_snapshot" :: held 11.897s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc-31828c40-43f4-42ab-9a51-1e901dc996c0" released by "_create_volume_from_snapshot" :: held 11.975s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.101s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2410bb06-e5ed-4f37-9c65-67eb260f9350 tempest-GroupSnapshotsTest-290551935 None] Create group from source-snapshot-5125008d-7098-47b5-ab4a-44a32d7a9fb9 completed successfully.
Sep 10 17:24:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a558e-b6e0-4458-b8e3-159c7aae83d7]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:12 devstack quobyte-client[82918]: System call of process 89755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0" returned: 0 in 0.567s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31828c40-43f4-42ab-9a51-1e901dc996c0" returned: 0 in 0.115s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-31828c40-43f4-42ab-9a51-1e901dc996c0" released by "delete_volume" :: held 0.951s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['e418e7d6-4803-40d9-b3fb-a102103780fd'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:13 devstack cinder-volume[82884]: WARNING cinder.quota [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-676162584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-676162584, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:13 devstack cinder-volume[82884]: WARNING cinder.quota [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-676162584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-676162584, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['c6b9e216-b535-43fa-bf8a-274e857e4959', '0ec12cef-124f-43ef-b7b7-200105f1b747', '21083b67-8812-4d78-89ce-2c9e74df7f4f', '9fd2e185-3d9a-4121-af99-352d453161ca'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.123s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:14 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:24:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2aacb754-4799-43ed-81e5-4ce8f06841e3 tempest-GroupSnapshotsTest-290551935 None] Delete group completed successfully.
Sep 10 17:24:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: deleting
Sep 10 17:24:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: deleting {{(pid=82884) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 17:24:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" acquired by "delete_snapshot" :: waited 0.111s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Deleting offline snapshot 79f71067-6c73-46d8-b821-6056e58232cc of volume 3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] snapshot_file for this snap is: volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dcc463-68c7-4d81-a652-5499ee04bd7d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:16 devstack quobyte-client[82918]: System call of process 89763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 1.479s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:24:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e58c5f-04a3-4eb8-95be-25c205fee14d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.794s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:17 devstack quobyte-client[82918]: System call of process 89783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.706s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e.79f71067-6c73-46d8-b821-6056e58232cc" returned: 0 in 0.278s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-79f71067-6c73-46d8-b821-6056e58232cc" released by "_delete_snapshot" :: held 4.135s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" released by "delete_snapshot" :: held 4.334s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:20 devstack cinder-volume[82884]: WARNING cinder.quota [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-676162584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-676162584, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:20 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['1c501932-59a7-43b4-a45a-ca91c7e6e944', 'fe443a7d-b4e6-4ad1-a19b-cccb8f8bafc2', 'a92a28f7-3309-40ef-b5ee-bc57760c0db9', '4ee888f9-c880-4180-a469-5f3b23110731'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-891fd4f7-3f9d-422f-8234-2563020b8917 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 5125008d-7098-47b5-ab4a-44a32d7a9fb9: deleted successfully
Sep 10 17:24:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb23c6-4aae-4c1e-8e36-a2c5435f7220]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:22 devstack quobyte-client[82918]: System call of process 89797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 1.076s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" returned: 0 in 0.178s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-3a63ccfd-1cad-4bbf-96db-6e52b84a9c4e" released by "delete_volume" :: held 1.611s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:23 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Created reservations ['384a8645-cb78-4d75-a981-a93fbf2c8cbd'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:24 devstack cinder-volume[82884]: WARNING cinder.db.sqlalchemy.api [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-676162584']
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Created reservations ['816012ec-ec0d-4ccc-9029-9e5b05796e73', '7f0ad58e-8de9-46d7-873a-7d266cbab2d8', 'e71aff4a-d127-4c8a-8f77-a8f6e29f07f3', 'c2813714-1e63-4414-82fa-87ffb8b070bc'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.229s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:24 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:24:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-996931d4-c04a-4ff8-baf6-810cb1fa2cca tempest-GroupSnapshotsTest-290551935 None] Delete group completed successfully.
Sep 10 17:24:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9a644db2-7d1e-45bd-a1d0-77138854e6d1 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9a644db2-7d1e-45bd-a1d0-77138854e6d1 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-830036391: creating
Sep 10 17:24:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9a644db2-7d1e-45bd-a1d0-77138854e6d1 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-830036391: created successfully
Sep 10 17:24:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9a644db2-7d1e-45bd-a1d0-77138854e6d1 tempest-GroupSnapshotsTest-290551935 None] Create group completed successfully.
Sep 10 17:24:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (c4510dfd-e83b-4755-924a-b3764be27aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b03b9d-6ebe-4f7b-b6c7-eed02f3ce4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b03b9d-6ebe-4f7b-b6c7-eed02f3ce4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906769886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,host='devstack@QuobyteHD#QuobyteHD',id=a924368c-7e36-4589-9ce7-41b15592b1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:28Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce3759e2-ff61-4933-89eb-c5e86d58c136),volume_type_id=ce3759e2-ff61-4933-89eb-c5e86d58c136)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c34c16-e4b4-466e-a3ef-ff43cfb84126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c34c16-e4b4-466e-a3ef-ff43cfb84126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129092c7-0f5e-49e8-a7be-410f092559f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129092c7-0f5e-49e8-a7be-410f092559f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a924368c-7e36-4589-9ce7-41b15592b1cf', 'volume_name': 'volume-a924368c-7e36-4589-9ce7-41b15592b1cf', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2529689e-b7e8-4d8a-bee5-4d7a9733610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2529689e-b7e8-4d8a-bee5-4d7a9733610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24da112-06a6-43f3-9dfe-79de1f8009f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Volume a924368c-7e36-4589-9ce7-41b15592b1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a924368c-7e36-4589-9ce7-41b15592b1cf', 'volume_size': 1}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,created_at=2025-09-10T15:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1906769886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,host='devstack@QuobyteHD#QuobyteHD',id=a924368c-7e36-4589-9ce7-41b15592b1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:28Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce3759e2-ff61-4933-89eb-c5e86d58c136),volume_type_id=ce3759e2-ff61-4933-89eb-c5e86d58c136)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Creating volume a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:24:28 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:28 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=30, name=volume-a924368c-7e36-4589-9ce7-41b15592b1cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf 1073741824" returned: 0 in 0.571s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf" returned: 0 in 0.179s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] <== create_volume: return (815ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24da112-06a6-43f3-9dfe-79de1f8009f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a924368c-7e36-4589-9ce7-41b15592b1cf', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6479d6-4b19-4dcb-b1e4-f06b162d6a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Volume volume-a924368c-7e36-4589-9ce7-41b15592b1cf (a924368c-7e36-4589-9ce7-41b15592b1cf): created successfully
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6479d6-4b19-4dcb-b1e4-f06b162d6a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (c4510dfd-e83b-4755-924a-b3764be27aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0bb85b8b-eb00-4d2c-be6f-2d899b557b9d tempest-GroupSnapshotsTest-290551935 None] Created volume successfully.
Sep 10 17:24:31 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (32f08708-b392-4b20-b8e2-abeffa26d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe072a52-7d3b-4c02-908b-deb26b3bb1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe072a52-7d3b-4c02-908b-deb26b3bb1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1897761213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,host='devstack@QuobyteHD#QuobyteHD',id=4dc6a1ca-c67e-47ab-9edf-4b84484b63a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:31Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce3759e2-ff61-4933-89eb-c5e86d58c136),volume_type_id=ce3759e2-ff61-4933-89eb-c5e86d58c136)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625648f8-dc9a-427d-9913-3f0ce262f95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (625648f8-dc9a-427d-9913-3f0ce262f95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba0d8f4-6889-4b70-be65-4354265f64d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba0d8f4-6889-4b70-be65-4354265f64d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc6a1ca-c67e-47ab-9edf-4b84484b63a5', 'volume_name': 'volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcece5d-d759-4891-8fec-834b2fbea7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fcece5d-d759-4891-8fec-834b2fbea7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc10571-b2a6-4704-bdee-5a54f6c3002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:31 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Volume 4dc6a1ca-c67e-47ab-9edf-4b84484b63a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5', 'volume_size': 1}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,created_at=2025-09-10T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1897761213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b667fa20-9992-43fc-92a2-7687cf24e8bf,host='devstack@QuobyteHD#QuobyteHD',id=4dc6a1ca-c67e-47ab-9edf-4b84484b63a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:31Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce3759e2-ff61-4933-89eb-c5e86d58c136),volume_type_id=ce3759e2-ff61-4933-89eb-c5e86d58c136)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Creating volume 4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:24:31 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:24:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:31 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=31, name=volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 1073741824" returned: 0 in 0.735s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" returned: 0 in 0.269s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] <== create_volume: return (1223ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:24:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc10571-b2a6-4704-bdee-5a54f6c3002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d3f289-a090-4ef1-85e2-f98f8a1f6226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:33 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Volume volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 (4dc6a1ca-c67e-47ab-9edf-4b84484b63a5): created successfully
Sep 10 17:24:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d3f289-a090-4ef1-85e2-f98f8a1f6226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (32f08708-b392-4b20-b8e2-abeffa26d795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-10532fc8-4c9d-48e5-88ae-e53849b33f52 tempest-GroupSnapshotsTest-290551935 None] Created volume successfully.
Sep 10 17:24:34 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-092e99cc-ef58-4c12-9275-2c6414b8c5ef tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-092e99cc-ef58-4c12-9275-2c6414b8c5ef tempest-GroupSnapshotsTest-290551935 None] Update group completed successfully.
Sep 10 17:24:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-eccde571-33a9-4490-a92b-21241553f356 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-eccde571-33a9-4490-a92b-21241553f356 tempest-GroupSnapshotsTest-290551935 None] Update group completed successfully.
Sep 10 17:24:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (5abc5e8b-4664-4f3e-b6ef-f965f0596f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4f45bb-3683-4ef9-afd3-b066db5a3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4f45bb-3683-4ef9-afd3-b066db5a3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000255394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb42825-5a0c-4817-9b84-6666676305d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:37Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a0994-43ec-42bb-b43b-814f0829934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a0994-43ec-42bb-b43b-814f0829934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df59aee-dd39-45fd-acb2-a3320cc93029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df59aee-dd39-45fd-acb2-a3320cc93029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb42825-5a0c-4817-9b84-6666676305d0', 'volume_name': 'volume-cfb42825-5a0c-4817-9b84-6666676305d0', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d8aec2-e99f-46ae-8553-424bb6c9b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d8aec2-e99f-46ae-8553-424bb6c9b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b70e32e-0bee-4bcb-b4b3-088880a745af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:37 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Volume cfb42825-5a0c-4817-9b84-6666676305d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb42825-5a0c-4817-9b84-6666676305d0', 'volume_size': 1}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1000255394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb42825-5a0c-4817-9b84-6666676305d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:24:37Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Creating volume cfb42825-5a0c-4817-9b84-6666676305d0 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:24:37 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:37 devstack quobyte-client[82918]: System call of process 89850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:37 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=32, name=volume-cfb42825-5a0c-4817-9b84-6666676305d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-094f31c6-dca1-4bcd-bf2d-31494c288960 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 1073741824" returned: 0 in 0.570s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0" returned: 0 in 0.279s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] <== create_volume: return (884ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:24:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b70e32e-0bee-4bcb-b4b3-088880a745af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb42825-5a0c-4817-9b84-6666676305d0', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8093645-a557-4246-80e6-2ccddc98344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:24:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-094f31c6-dca1-4bcd-bf2d-31494c288960 tempest-GroupSnapshotsTest-290551935 None] Update group completed successfully.
Sep 10 17:24:38 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Volume volume-cfb42825-5a0c-4817-9b84-6666676305d0 (cfb42825-5a0c-4817-9b84-6666676305d0): created successfully
Sep 10 17:24:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8093645-a557-4246-80e6-2ccddc98344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:24:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (5abc5e8b-4664-4f3e-b6ef-f965f0596f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:24:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-51e49a60-1bc1-414f-bbf2-ac3569e6ff25 tempest-AttachVolumeTestJSON-704514118 None] Created volume successfully.
Sep 10 17:24:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-eec48e84-ab1d-4e78-b3e3-1449ee118e9f tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-eec48e84-ab1d-4e78-b3e3-1449ee118e9f tempest-GroupSnapshotsTest-290551935 None] Update group completed successfully.
Sep 10 17:24:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] GroupSnapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: creating.
Sep 10 17:24:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Group snapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: creating. {{(pid=82884) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Creating offline snapshot 05e6606b-6084-48b7-a9b3-e5e4f3d1d5db of volume 4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[1387d7ca-9239-4a17-a2ff-cbb1756d1257]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" returned: 0 in 0.560s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:41 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=33, name=volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db 1G" returned: 0 in 0.311s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img rebase -u -b volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.104s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.info" returned: 0 in 0.122s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.info" returned: 0 in 0.141s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Creating offline snapshot e16deb85-cd7d-40ad-b185-9b4b0c20bca8 of volume a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[180e5128-76a4-4a85-8e9f-a2d9c37a4b37]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:43 devstack quobyte-client[82918]: System call of process 89867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf" returned: 0 in 0.601s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:43 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=35, name=volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 1G" returned: 0 in 0.359s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a924368c-7e36-4589-9ce7-41b15592b1cf -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img rebase -u -b volume-a924368c-7e36-4589-9ce7-41b15592b1cf -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.209s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:24:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.135s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.359s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.info" returned: 0 in 0.189s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.info" returned: 0 in 0.121s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.408s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2d339d-627a-4d74-ba14-66cbcf17b624]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2da579c4-c2d5-4cb7-9122-d42a1912b5e0 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: created successfully
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0" returned: 0 in 0.675s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.742s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-cfb42825-5a0c-4817-9b84-6666676305d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfe3d312-f283-46b2-bf43-380ec4d2728b', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:24:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-6cc16d48-8aa4-45a2-b8de-792465e99aef req-739ed391-cc16-4c1b-ab53-497a2103e746 tempest-AttachVolumeTestJSON-704514118 None] attachment_update completed successfully.
Sep 10 17:24:46 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: deleting
Sep 10 17:24:46 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: deleting {{(pid=82884) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" acquired by "delete_snapshot" :: waited 0.091s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Deleting offline snapshot 05e6606b-6084-48b7-a9b3-e5e4f3d1d5db of volume 4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] snapshot_file for this snap is: volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e4b2e-f666-4bfc-a943-336871482804]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.781s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fad27e-bb41-468d-8343-f3fe1feb53a9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" returned: 0 in 0.511s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.324s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5.05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" returned: 0 in 0.093s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-05e6606b-6084-48b7-a9b3-e5e4f3d1d5db" released by "_delete_snapshot" :: held 2.059s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" released by "delete_snapshot" :: held 2.101s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-e16deb85-cd7d-40ad-b185-9b4b0c20bca8" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-e16deb85-cd7d-40ad-b185-9b4b0c20bca8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Deleting offline snapshot e16deb85-cd7d-40ad-b185-9b4b0c20bca8 of volume a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] snapshot_file for this snap is: volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a77540-ee60-466f-8ece-bad846357d9a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:49 devstack quobyte-client[82918]: System call of process 90289 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.496s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a924368c-7e36-4589-9ce7-41b15592b1cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdab4c8d-c3b2-4cdf-9c4f-b042d17e44d1]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf" returned: 0 in 0.485s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:49 devstack quobyte-client[82918]: System call of process 90295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.249s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf.e16deb85-cd7d-40ad-b185-9b4b0c20bca8" returned: 0 in 0.193s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-e16deb85-cd7d-40ad-b185-9b4b0c20bca8" released by "_delete_snapshot" :: held 1.882s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" released by "delete_snapshot" :: held 1.919s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:51 devstack cinder-volume[82884]: WARNING cinder.quota [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1741237752 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1741237752, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:51 devstack cinder-volume[82884]: WARNING cinder.quota [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1741237752 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1741237752, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:51 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['b78be5c3-4b8c-42a8-bcd4-3764db50a867', '2750f393-6e84-419f-9826-cf424ac1765a', '666ca68d-f38c-44b3-abfd-72395fdf4c77', '35d6ac66-aea4-434f-95ca-a7675bbe7ec3'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:51 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['614308b7-a904-4640-8d46-24133a6a5d35', '260510a4-7a40-4827-bfe9-7758f1295365', '009ef805-32ab-4bfd-8fe2-804f341adad2', '94656410-6771-4b8a-9bea-ef11626a3a49'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-56de11ee-9de9-4882-b541-4452973d2469 tempest-GroupSnapshotsTest-290551935 None] group_snapshot 2c3158fc-442e-478b-81f5-c0784ca2f39a: deleted successfully
Sep 10 17:24:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:24:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:52 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d1baa-b971-49d8-ace6-4682172bbc98]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" returned: 0 in 0.824s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" returned: 0 in 0.178s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-4dc6a1ca-c67e-47ab-9edf-4b84484b63a5" released by "delete_volume" :: held 1.509s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" acquired by "delete_volume" :: waited 0.032s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b3e4e5-d31f-4d2d-bb4c-e4f0a70c6fb0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:24:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:55 devstack quobyte-client[82918]: System call of process 90318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:24:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf" returned: 0 in 1.108s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a924368c-7e36-4589-9ce7-41b15592b1cf" returned: 0 in 0.383s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-a924368c-7e36-4589-9ce7-41b15592b1cf" released by "delete_volume" :: held 2.419s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:24:57 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['4990a64d-a469-43fc-8910-f59e5a3998b9'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:57 devstack cinder-volume[82884]: WARNING cinder.quota [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1741237752 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1741237752, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:24:57 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['72323457-9a1d-4467-ac2b-e5ccd92f7cf3', '2b57e865-77f3-4ab2-b65e-b7fb9cd7c2ce', '5936df35-b0cb-448a-82a1-019c1a731d88', '5d65be15-5d60-4151-9780-8bb22a2b304e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['dcf35eb3-14c9-474c-b627-30bf1fa9448e', '514140b7-d75f-43b3-a139-0c021310802b', '012989ee-aecd-42ee-b7c6-b71f4acf6bb6', '44c364f8-aed5-44a6-b6a5-b2a6e85fddc2'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.153s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:24:58 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:24:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4355bb50-f6e8-4bcc-addc-2c1eb06180e5 tempest-GroupSnapshotsTest-290551935 None] Delete group completed successfully.
Sep 10 17:25:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-022a5abd-2633-4177-9681-74b1bf1ce226 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-022a5abd-2633-4177-9681-74b1bf1ce226 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-1332653705: creating
Sep 10 17:25:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-022a5abd-2633-4177-9681-74b1bf1ce226 tempest-GroupSnapshotsTest-290551935 None] Group tempest-GroupSnapshotsTest-Group-1332653705: created successfully
Sep 10 17:25:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-022a5abd-2633-4177-9681-74b1bf1ce226 tempest-GroupSnapshotsTest-290551935 None] Create group completed successfully.
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.217s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:25:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:02 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (c591c5c1-7b0c-464f-b59e-36337afd993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7763c3-14cc-4d66-9fa6-9b55a51a8e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7763c3-14cc-4d66-9fa6-9b55a51a8e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483622032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f53a734-c80d-4113-b989-b902249e167b,host='devstack@QuobyteHD#QuobyteHD',id=73262594-cfa9-44c8-a39d-69c432657033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:02Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387a68b2-e3a7-4247-ae3d-9520ec2a4e8d),volume_type_id=387a68b2-e3a7-4247-ae3d-9520ec2a4e8d)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620c1938-3c5d-4c0d-91be-cb6c402786d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620c1938-3c5d-4c0d-91be-cb6c402786d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6d4397-478d-402d-a5a3-4cede221a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6d4397-478d-402d-a5a3-4cede221a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73262594-cfa9-44c8-a39d-69c432657033', 'volume_name': 'volume-73262594-cfa9-44c8-a39d-69c432657033', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059f01d-58ae-4c41-90b0-a39245b095af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059f01d-58ae-4c41-90b0-a39245b095af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6f2c64-61ec-4555-b7b0-525bfb7af35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:03 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Volume 73262594-cfa9-44c8-a39d-69c432657033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73262594-cfa9-44c8-a39d-69c432657033', 'volume_size': 1}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4f53a734-c80d-4113-b989-b902249e167b,created_at=2025-09-10T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-483622032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f53a734-c80d-4113-b989-b902249e167b,host='devstack@QuobyteHD#QuobyteHD',id=73262594-cfa9-44c8-a39d-69c432657033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219b1ca8d953438aaff418bb78497b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:02Z,use_quota=True,user_id='e81b7d53f553484c8ebb3b4e81c6d570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387a68b2-e3a7-4247-ae3d-9520ec2a4e8d),volume_type_id=387a68b2-e3a7-4247-ae3d-9520ec2a4e8d)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Creating volume 73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:25:03 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:25:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:04 devstack quobyte-client[82918]: System call of process 90485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:04 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=37, name=volume-73262594-cfa9-44c8-a39d-69c432657033, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 1073741824" returned: 0 in 1.415s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033" returned: 0 in 0.875s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] <== create_volume: return (2698ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:25:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.790s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6f2c64-61ec-4555-b7b0-525bfb7af35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73262594-cfa9-44c8-a39d-69c432657033', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c7c45d-da1d-4e64-b1b0-bdfbab5ac16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Volume volume-73262594-cfa9-44c8-a39d-69c432657033 (73262594-cfa9-44c8-a39d-69c432657033): created successfully
Sep 10 17:25:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c7c45d-da1d-4e64-b1b0-bdfbab5ac16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Flow 'volume_create_manager' (c591c5c1-7b0c-464f-b59e-36337afd993c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e2f50255-2fe4-4153-80df-1d3273eb81ff tempest-GroupSnapshotsTest-290551935 None] Created volume successfully.
Sep 10 17:25:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] GroupSnapshot 03eaf253-5dce-439e-853b-7703472a3972: creating.
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=77,cinder:SELECT=75,cinder:INSERT=17,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=79,cinder:SELECT=88,cinder:INSERT=14,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:25:08 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Group snapshot 03eaf253-5dce-439e-853b-7703472a3972: creating. {{(pid=82884) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Creating offline snapshot cd43a2f1-611d-45bf-926c-208f7bf42d8d of volume 73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[125178e3-c25b-4cbf-b617-dfe4eed3b6b3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:09 devstack quobyte-client[82918]: System call of process 90701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033" returned: 0 in 1.193s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:10 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=38, name=volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d 1G" returned: 0 in 0.678s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img rebase -u -b volume-73262594-cfa9-44c8-a39d-69c432657033 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img rebase -u -b volume-73262594-cfa9-44c8-a39d-69c432657033 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 0.254s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 0.198s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 0.280s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.info" returned: 0 in 0.229s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:25:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.info" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e777a5dc-0080-43b2-b878-88b0b687e7dc tempest-GroupSnapshotsTest-290551935 None] group_snapshot 03eaf253-5dce-439e-853b-7703472a3972: created successfully
Sep 10 17:25:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] group_snapshot 03eaf253-5dce-439e-853b-7703472a3972: deleting
Sep 10 17:25:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] group_snapshot 03eaf253-5dce-439e-853b-7703472a3972: deleting {{(pid=82884) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" acquired by "delete_snapshot" :: waited 0.122s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-cd43a2f1-611d-45bf-926c-208f7bf42d8d" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-cd43a2f1-611d-45bf-926c-208f7bf42d8d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Deleting offline snapshot cd43a2f1-611d-45bf-926c-208f7bf42d8d of volume 73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] snapshot_file for this snap is: volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ca7e0-fdb7-4e13-b573-e6d0879e299a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 0.921s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73262594-cfa9-44c8-a39d-69c432657033(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:25:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429617b-cdaf-470e-a0ab-1a2d580cd534]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:17 devstack quobyte-client[82918]: System call of process 90739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033" returned: 0 in 2.733s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:18 devstack quobyte-client[82918]: System call of process 91158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:18 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:25:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (9d0343b3-2519-4f22-94ce-0b1acbfb9a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177ab2bf-5745-40f5-ba48-f4300559475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177ab2bf-5745-40f5-ba48-f4300559475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2081224237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd0c3fc-afce-42db-883d-d1447974464f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:17Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0b50b1-e75c-4186-a7ae-ab8902c9fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0b50b1-e75c-4186-a7ae-ab8902c9fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b393fc5-977b-4ab2-8555-5e618ec11a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b393fc5-977b-4ab2-8555-5e618ec11a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd0c3fc-afce-42db-883d-d1447974464f', 'volume_name': 'volume-bbd0c3fc-afce-42db-883d-d1447974464f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e29a59-264d-4b87-af19-b956db89d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e29a59-264d-4b87-af19-b956db89d26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04aa9fe3-b82b-489a-99d7-c0c40d93d373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Volume bbd0c3fc-afce-42db-883d-d1447974464f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd0c3fc-afce-42db-883d-d1447974464f', 'volume_size': 1}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2081224237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd0c3fc-afce-42db-883d-d1447974464f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:17Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Creating volume bbd0c3fc-afce-42db-883d-d1447974464f {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:25:19 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 1.625s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:19 devstack quobyte-client[82918]: System call of process 91167 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=40, name=volume-bbd0c3fc-afce-42db-883d-d1447974464f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033.cd43a2f1-611d-45bf-926c-208f7bf42d8d" returned: 0 in 0.189s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-cd43a2f1-611d-45bf-926c-208f7bf42d8d" released by "_delete_snapshot" :: held 6.636s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f 1073741824" returned: 0 in 1.280s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" released by "delete_snapshot" :: held 6.922s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f" returned: 0 in 1.824s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (3143ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.151s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04aa9fe3-b82b-489a-99d7-c0c40d93d373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd0c3fc-afce-42db-883d-d1447974464f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a9eeec-414f-4f3a-90c3-9ba8646aae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:22 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Volume volume-bbd0c3fc-afce-42db-883d-d1447974464f (bbd0c3fc-afce-42db-883d-d1447974464f): created successfully
Sep 10 17:25:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a9eeec-414f-4f3a-90c3-9ba8646aae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (9d0343b3-2519-4f22-94ce-0b1acbfb9a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-31bf5ac9-8198-4f4c-8ad4-98993ca145c0 tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:25:23 devstack cinder-volume[82884]: WARNING cinder.quota [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1710892404 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1710892404, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:25:23 devstack cinder-volume[82884]: WARNING cinder.quota [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1710892404 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1710892404, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:25:24 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] Created reservations ['ad3def81-6619-429a-bbd9-ba0cd51f8eef', 'c770c1ed-edeb-4d75-b2af-919b9be3965b', '07407860-53e7-40f0-8476-abb4369b6893', '31dab125-c9ba-4661-b068-99c27717b9ed'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:25:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f" by "attach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f" acquired by "attach_volume" :: waited 0.054s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fdd4069e-8e45-4eb2-bc2d-75614106cf3a tempest-GroupSnapshotsTest-290551935 None] group_snapshot 03eaf253-5dce-439e-853b-7703472a3972: deleted successfully
Sep 10 17:25:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Attaching volume bbd0c3fc-afce-42db-883d-d1447974464f to instance 4ab4611a-953c-425b-8812-10b51510a11e at mountpoint /dev/vdb on host None.
Sep 10 17:25:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Attach volume completed successfully.
Sep 10 17:25:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fefe99d6-5a6d-4510-84ff-9686b7b24072 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f" released by "attach_volume" :: held 1.302s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004ed72-31e2-4d86-a79d-d1f28bf1bea5]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Terminate volume connection completed successfully.
Sep 10 17:25:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" by "detach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:30 devstack quobyte-client[82918]: System call of process 91261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" acquired by "detach_volume" :: waited 0.126s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Detaching volume bbd0c3fc-afce-42db-883d-d1447974464f from instance 4ab4611a-953c-425b-8812-10b51510a11e.
Sep 10 17:25:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033" returned: 0 in 2.181s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Detach volume completed successfully.
Sep 10 17:25:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-73262594-cfa9-44c8-a39d-69c432657033" returned: 0 in 1.393s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e99de81c-ede2-47f1-9c66-c4738ce5c8a0 tempest-VolumesActionsTest-988836999 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" released by "detach_volume" :: held 1.764s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Lock "cinder-quobyte-73262594-cfa9-44c8-a39d-69c432657033" released by "delete_volume" :: held 3.887s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:32 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['8929060f-e09c-4baa-abbe-46c0e1029970'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:25:32 devstack cinder-volume[82884]: WARNING cinder.quota [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1710892404 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1710892404, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:25:32 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Created reservations ['51bfd3c1-3710-4c80-8b72-55b8c48bb180', '949a2e29-4d56-4828-b4f4-6bf230d47bc5', '011e7c6f-767b-49f3-b844-5e77b91e9448', 'b8189561-ce2d-4bc7-a037-7891a13e73c3'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec3fad93-f80e-4394-aa14-7cbb39f8c7fb tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" by "detach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec3fad93-f80e-4394-aa14-7cbb39f8c7fb tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" acquired by "detach_volume" :: waited 0.468s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ec3fad93-f80e-4394-aa14-7cbb39f8c7fb tempest-VolumesActionsTest-1414098508 None] Volume detach called, but volume not attached.
Sep 10 17:25:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 1.837s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:35 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:25:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-308a9d54-e931-402f-b397-24db5a217fb1 tempest-GroupSnapshotsTest-290551935 None] Delete group completed successfully.
Sep 10 17:25:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec3fad93-f80e-4394-aa14-7cbb39f8c7fb tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-detach_volume" released by "detach_volume" :: held 0.981s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-quobyte-bbd0c3fc-afce-42db-883d-d1447974464f" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-quobyte-bbd0c3fc-afce-42db-883d-d1447974464f" acquired by "delete_volume" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a931fa8-56b3-4622-8c17-3a49fce84e60]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f" returned: 0 in 0.910s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-bbd0c3fc-afce-42db-883d-d1447974464f" returned: 0 in 0.336s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-quobyte-bbd0c3fc-afce-42db-883d-d1447974464f" released by "delete_volume" :: held 1.598s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Created reservations ['75a2b463-6c57-45c4-951a-6010dcc6bbd4', 'f062307d-1ab9-401f-b676-0048c2fbfec0', 'a3bed331-f196-41ce-8c76-da53c4a7e121', 'a52bffcb-0eed-41e1-a299-d4f5d54bc3eb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.233s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:39 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:25:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Deleted volume successfully.
Sep 10 17:25:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4aef64c9-b944-4707-bc03-f6270f9d8fe7 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-bbd0c3fc-afce-42db-883d-d1447974464f-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:49 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=20,cinder:SELECT=30,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:25:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-867c2914-28c6-42a8-84ef-80b3116a5279 tempest-GroupSnapshotsV319Test-2025364557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-867c2914-28c6-42a8-84ef-80b3116a5279 tempest-GroupSnapshotsV319Test-2025364557 None] Group tempest-GroupSnapshotsV319Test-Group-84141710: creating
Sep 10 17:25:50 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-867c2914-28c6-42a8-84ef-80b3116a5279 tempest-GroupSnapshotsV319Test-2025364557 None] Group tempest-GroupSnapshotsV319Test-Group-84141710: created successfully
Sep 10 17:25:50 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-867c2914-28c6-42a8-84ef-80b3116a5279 tempest-GroupSnapshotsV319Test-2025364557 None] Create group completed successfully.
Sep 10 17:25:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (d6696456-33a0-4f2f-b9e2-85541cc6f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e49e35c-2cc6-40d6-9e86-8659980a48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e49e35c-2cc6-40d6-9e86-8659980a48ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279110517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85390250-8160-41a4-86bf-c2d2f6bf7722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:51Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f9faed-3205-468b-9914-9f33684e25f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f9faed-3205-468b-9914-9f33684e25f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc486f6-235b-47ff-83b1-ec9164c4fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc486f6-235b-47ff-83b1-ec9164c4fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85390250-8160-41a4-86bf-c2d2f6bf7722', 'volume_name': 'volume-85390250-8160-41a4-86bf-c2d2f6bf7722', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8240b38e-eb4c-4729-8024-c31d8d62f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8240b38e-eb4c-4729-8024-c31d8d62f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ec996b-ad20-4896-a621-22c4726f726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Volume 85390250-8160-41a4-86bf-c2d2f6bf7722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85390250-8160-41a4-86bf-c2d2f6bf7722', 'volume_size': 1}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279110517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85390250-8160-41a4-86bf-c2d2f6bf7722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:51Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Creating volume 85390250-8160-41a4-86bf-c2d2f6bf7722 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:25:50 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:25:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:51 devstack quobyte-client[82918]: System call of process 91354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:51 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=41, name=volume-85390250-8160-41a4-86bf-c2d2f6bf7722, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722 1073741824" returned: 0 in 0.581s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722" returned: 0 in 0.422s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (1080ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:51 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:51 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Flow 'volume_create_manager' (d815ebc1-fbb6-4b93-8e6a-04268929c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383878b5-365b-41e4-a104-993b1436133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ec996b-ad20-4896-a621-22c4726f726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85390250-8160-41a4-86bf-c2d2f6bf7722', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a10b826-40ab-4435-9acd-110fd8a07013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383878b5-365b-41e4-a104-993b1436133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843779997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd2a3072-3dff-4d4c-8f41-b5f111621322,host='devstack@QuobyteHD#QuobyteHD',id=2981ac00-2a71-4081-b220-9d953e158d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24afdf0afec04c0495a14b265880130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:51Z,use_quota=True,user_id='c78b3be52e9f4dbaa0863599d0398335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(014aabee-df04-489f-988e-9872500fe5ae),volume_type_id=014aabee-df04-489f-988e-9872500fe5ae)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff6dc5-9cc3-4791-8e4b-a0bd593becaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff6dc5-9cc3-4791-8e4b-a0bd593becaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67141d4d-7c93-4208-a0c9-d85e80cc721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67141d4d-7c93-4208-a0c9-d85e80cc721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2981ac00-2a71-4081-b220-9d953e158d8a', 'volume_name': 'volume-2981ac00-2a71-4081-b220-9d953e158d8a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2183dce1-6e05-4a98-84eb-6bfbcba0b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2183dce1-6e05-4a98-84eb-6bfbcba0b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed11108-7bbd-4b47-8e4a-0a58f3886d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Volume 2981ac00-2a71-4081-b220-9d953e158d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2981ac00-2a71-4081-b220-9d953e158d8a', 'volume_size': 1}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cd2a3072-3dff-4d4c-8f41-b5f111621322,created_at=2025-09-10T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-843779997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd2a3072-3dff-4d4c-8f41-b5f111621322,host='devstack@QuobyteHD#QuobyteHD',id=2981ac00-2a71-4081-b220-9d953e158d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24afdf0afec04c0495a14b265880130a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:51Z,use_quota=True,user_id='c78b3be52e9f4dbaa0863599d0398335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(014aabee-df04-489f-988e-9872500fe5ae),volume_type_id=014aabee-df04-489f-988e-9872500fe5ae)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Creating volume 2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:25:52 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Volume volume-85390250-8160-41a4-86bf-c2d2f6bf7722 (85390250-8160-41a4-86bf-c2d2f6bf7722): created successfully
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a10b826-40ab-4435-9acd-110fd8a07013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (d6696456-33a0-4f2f-b9e2-85541cc6f337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:52 devstack quobyte-client[82918]: System call of process 91358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:25:52 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=42, name=volume-2981ac00-2a71-4081-b220-9d953e158d8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c7620752-c1be-494c-8e62-1d178fc52660 tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a 1073741824" returned: 0 in 0.651s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a" returned: 0 in 0.127s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] <== create_volume: return (828ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed11108-7bbd-4b47-8e4a-0a58f3886d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2981ac00-2a71-4081-b220-9d953e158d8a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c43c357-6e59-4c1a-bba6-0005e2b62ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:53 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Volume volume-2981ac00-2a71-4081-b220-9d953e158d8a (2981ac00-2a71-4081-b220-9d953e158d8a): created successfully
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c43c357-6e59-4c1a-bba6-0005e2b62ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Flow 'volume_create_manager' (d815ebc1-fbb6-4b93-8e6a-04268929c110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5e712ce5-6ec3-4d84-afe9-043d25835055 tempest-GroupSnapshotsV319Test-2025364557 None] Created volume successfully.
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-85390250-8160-41a4-86bf-c2d2f6bf7722-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "cinder-85390250-8160-41a4-86bf-c2d2f6bf7722-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-quobyte-85390250-8160-41a4-86bf-c2d2f6bf7722" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-85390250-8160-41a4-86bf-c2d2f6bf7722" acquired by "delete_volume" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337b73d-9357-4763-9ed3-f06df1836938]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] GroupSnapshot 8003404a-c010-48b3-9499-1f17aa10e633: creating.
Sep 10 17:25:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722" returned: 0 in 0.937s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Group snapshot 8003404a-c010-48b3-9499-1f17aa10e633: creating. {{(pid=82884) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-85390250-8160-41a4-86bf-c2d2f6bf7722" returned: 0 in 0.408s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-85390250-8160-41a4-86bf-c2d2f6bf7722" released by "delete_volume" :: held 1.496s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Creating offline snapshot ed3be55b-b6f3-4a6d-a668-203dcf92c96a of volume 2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb89b8a-fb95-47f4-a5c4-6cc2a539cb0a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:55 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Created reservations ['ee92b6a8-6592-487d-b66f-7886011ae71e', '27323a3d-2e3d-403e-b40e-a918176acd33', 'ba28e275-20ac-425c-b860-f0d51def4305', 'd17dfd99-dd94-4815-bef3-209dc07a30df'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a" returned: 0 in 0.732s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:56 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=43, name=volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a 1G" returned: 0 in 0.423s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2981ac00-2a71-4081-b220-9d953e158d8a -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.293s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:25:56 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Deleted volume successfully.
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "qemu-img rebase -u -b volume-2981ac00-2a71-4081-b220-9d953e158d8a -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 0.369s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:25:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 0.392s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-08880151-2e7a-44a7-a7a7-086aa67527b6 tempest-VolumesActionsTest-988836999 None] Lock "cinder-85390250-8160-41a4-86bf-c2d2f6bf7722-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 0.318s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.info" returned: 0 in 0.181s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:25:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.info" returned: 0 in 0.140s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (a8b7b1ef-6cf1-41c0-98fd-4b16c711a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed1331-b692-429e-896f-95f458a8c693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ed1331-b692-429e-896f-95f458a8c693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959433544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d35c67-e9a2-4305-8988-21ba99e293cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:58Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1431b836-0ab5-49e6-a6e7-756414c7a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1431b836-0ab5-49e6-a6e7-756414c7a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1209-2469-4d04-9cfc-415cbbb9aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5d1209-2469-4d04-9cfc-415cbbb9aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d35c67-e9a2-4305-8988-21ba99e293cc', 'volume_name': 'volume-82d35c67-e9a2-4305-8988-21ba99e293cc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e701aa6-bbc0-4320-9dce-7083badcdcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e701aa6-bbc0-4320-9dce-7083badcdcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c17247-6a79-459c-8518-1d9437b3d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Volume 82d35c67-e9a2-4305-8988-21ba99e293cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d35c67-e9a2-4305-8988-21ba99e293cc', 'volume_size': 1}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959433544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d35c67-e9a2-4305-8988-21ba99e293cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:25:58Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Creating volume 82d35c67-e9a2-4305-8988-21ba99e293cc {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:25:58 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:25:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:58 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=45, name=volume-82d35c67-e9a2-4305-8988-21ba99e293cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc 1073741824" returned: 0 in 0.573s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc" returned: 0 in 0.415s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (1056ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c17247-6a79-459c-8518-1d9437b3d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d35c67-e9a2-4305-8988-21ba99e293cc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f4924-3e31-4f30-b41a-53f9c4547ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:25:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d86be0d0-7d65-42fe-ad22-39a3f178524f tempest-GroupSnapshotsV319Test-2025364557 None] group_snapshot 8003404a-c010-48b3-9499-1f17aa10e633: created successfully
Sep 10 17:25:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Volume volume-82d35c67-e9a2-4305-8988-21ba99e293cc (82d35c67-e9a2-4305-8988-21ba99e293cc): created successfully
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5f4924-3e31-4f30-b41a-53f9c4547ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:25:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (a8b7b1ef-6cf1-41c0-98fd-4b16c711a19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6ad729c1-7b8f-4829-9fb4-250db8cc19e1 tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:26:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] group_snapshot 8003404a-c010-48b3-9499-1f17aa10e633: deleting
Sep 10 17:26:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] group_snapshot 8003404a-c010-48b3-9499-1f17aa10e633: deleting {{(pid=82884) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" acquired by "delete_snapshot" :: waited 0.068s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "cinder-quobyte-ed3be55b-b6f3-4a6d-a668-203dcf92c96a" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-ed3be55b-b6f3-4a6d-a668-203dcf92c96a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Deleting offline snapshot ed3be55b-b6f3-4a6d-a668-203dcf92c96a of volume 2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] snapshot_file for this snap is: volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff51aa-8069-409a-9550-97bd78b50dce]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-82d35c67-e9a2-4305-8988-21ba99e293cc-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:01 devstack quobyte-client[82918]: System call of process 91393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "cinder-82d35c67-e9a2-4305-8988-21ba99e293cc-delete_volume" acquired by "delete_volume" :: waited 0.431s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.586s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 1.148s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2981ac00-2a71-4081-b220-9d953e158d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda82cc-8802-4957-862e-1775b6df543d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-quobyte-82d35c67-e9a2-4305-8988-21ba99e293cc" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-82d35c67-e9a2-4305-8988-21ba99e293cc" acquired by "delete_volume" :: waited 0.129s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e1d2a-1554-4426-a037-aa139a0351bd]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a" returned: 0 in 0.634s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 0.346s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a.ed3be55b-b6f3-4a6d-a668-203dcf92c96a" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc" returned: 0 in 0.868s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-ed3be55b-b6f3-4a6d-a668-203dcf92c96a" released by "_delete_snapshot" :: held 2.881s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" released by "delete_snapshot" :: held 2.967s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82d35c67-e9a2-4305-8988-21ba99e293cc" returned: 0 in 0.372s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-82d35c67-e9a2-4305-8988-21ba99e293cc" released by "delete_volume" :: held 1.414s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:04 devstack cinder-volume[82884]: WARNING cinder.quota [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2058343621 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2058343621, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:26:04 devstack cinder-volume[82884]: WARNING cinder.quota [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2058343621 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2058343621, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] Created reservations ['0f1f19fe-4664-417c-a716-88cbac9fa0cf', '7205be96-0232-4664-b0cd-308de203427c', '7c93d1c0-6120-405f-994d-e1f205140e95', 'd5771e26-5ab0-4797-aba8-e0969e606475'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Created reservations ['3732e516-e5d3-4798-ae79-38f1fe83dfe1', '2a327c8e-5c63-41a4-87eb-44ff9aef6e52', '5a1e3440-97af-4045-a1cf-4ea692deabb9', 'ea39518d-1041-4c57-a1c2-432ed5782451'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-02422c2e-2920-4692-8ede-ba7bf345cc77 tempest-GroupSnapshotsV319Test-2025364557 None] group_snapshot 8003404a-c010-48b3-9499-1f17aa10e633: deleted successfully
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Deleted volume successfully.
Sep 10 17:26:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcdfd97e-9160-43fb-9cef-5568d47762b5 tempest-VolumesActionsTest-988836999 None] Lock "cinder-82d35c67-e9a2-4305-8988-21ba99e293cc-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" acquired by "delete_volume" :: waited 0.029s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[544bce7c-37b8-450b-90be-5dd90635e7c9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a" returned: 0 in 0.611s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2981ac00-2a71-4081-b220-9d953e158d8a" returned: 0 in 0.467s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (342e0e3c-8eb2-4d90-87d1-c214590eb16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94bdce9-bc60-48a8-9853-85d51ca615e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "cinder-quobyte-2981ac00-2a71-4081-b220-9d953e158d8a" released by "delete_volume" :: held 1.450s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94bdce9-bc60-48a8-9853-85d51ca615e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1474731999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5312eb-672f-437a-b4b7-d291371eda10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:07Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2087b295-f6dd-45d2-8b6f-4cac221282e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2087b295-f6dd-45d2-8b6f-4cac221282e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea6ce10-8fcc-4803-9f22-f38839d4b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea6ce10-8fcc-4803-9f22-f38839d4b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5312eb-672f-437a-b4b7-d291371eda10', 'volume_name': 'volume-8a5312eb-672f-437a-b4b7-d291371eda10', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53600dd0-35df-4637-9b6a-35846fd755cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53600dd0-35df-4637-9b6a-35846fd755cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45b4eb0-9776-4b1b-ad96-f6cd4dcdacf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Volume 8a5312eb-672f-437a-b4b7-d291371eda10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5312eb-672f-437a-b4b7-d291371eda10', 'volume_size': 1}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1474731999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5312eb-672f-437a-b4b7-d291371eda10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:07Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Creating volume 8a5312eb-672f-437a-b4b7-d291371eda10 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:26:07 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:26:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:07 devstack quobyte-client[82918]: System call of process 91420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=46, name=volume-8a5312eb-672f-437a-b4b7-d291371eda10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10 1073741824" returned: 0 in 0.609s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10" returned: 0 in 0.292s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (1028ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45b4eb0-9776-4b1b-ad96-f6cd4dcdacf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5312eb-672f-437a-b4b7-d291371eda10', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87897223-f3b8-47e2-8e95-4b320c9fce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Created reservations ['dea6078c-c7a2-4585-8ccb-a16ea9426732'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:08 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Volume volume-8a5312eb-672f-437a-b4b7-d291371eda10 (8a5312eb-672f-437a-b4b7-d291371eda10): created successfully
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87897223-f3b8-47e2-8e95-4b320c9fce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (342e0e3c-8eb2-4d90-87d1-c214590eb16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a07ba7d9-e3b3-4800-9843-d9945cf33928 tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=68,cinder:UPDATE=82,cinder:INSERT=15,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:26:08 devstack cinder-volume[82884]: WARNING cinder.quota [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2058343621 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2058343621, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:26:08 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Created reservations ['089ace17-01cb-4cc7-b1ae-90ae32e95e53', 'bd5532ad-dd76-44c4-aef8-3e54ebe5c7fe', '7969a623-efb8-42ef-bb57-4d50d52f98df', 'd87a0a59-b582-4ff6-9a21-37521929fab5'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-8a5312eb-672f-437a-b4b7-d291371eda10-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.373s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "cinder-8a5312eb-672f-437a-b4b7-d291371eda10-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6f4e6376-3c91-47fb-9bdf-668321ca3153 tempest-GroupSnapshotsV319Test-2025364557 None] Delete group completed successfully.
Sep 10 17:26:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-quobyte-8a5312eb-672f-437a-b4b7-d291371eda10" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-8a5312eb-672f-437a-b4b7-d291371eda10" acquired by "delete_volume" :: waited 0.012s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a2c3d9-1557-46ff-8239-f535e2607ea8]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:10 devstack quobyte-client[82918]: System call of process 91426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10" returned: 0 in 0.610s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8a5312eb-672f-437a-b4b7-d291371eda10" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-8a5312eb-672f-437a-b4b7-d291371eda10" released by "delete_volume" :: held 1.106s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Created reservations ['03ef3cde-5827-4d6b-9139-b659a00525f8', 'eb744fec-2504-4cbc-9460-a24da2529c30', '2a7ca466-f278-49f8-b724-f01bcde1aef8', '3ef06a9c-c9e4-47b9-aad3-78f5616955a8'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.162s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:11 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Deleted volume successfully.
Sep 10 17:26:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-06a11b35-1471-461a-9f6e-8ccb743d6c02 tempest-VolumesActionsTest-988836999 None] Lock "cinder-8a5312eb-672f-437a-b4b7-d291371eda10-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (dc8873f0-193e-4767-8512-c68be7063f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173c901e-7c84-419d-9a84-c77e8a8d4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173c901e-7c84-419d-9a84-c77e8a8d4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1799101054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5b3796-46a5-49f9-afd1-4663fc223648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:13Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d5cca0-a114-4e39-8894-8e6dd1b3bf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d5cca0-a114-4e39-8894-8e6dd1b3bf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4d7af5-f3be-4062-b22c-6ee815066ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4d7af5-f3be-4062-b22c-6ee815066ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5b3796-46a5-49f9-afd1-4663fc223648', 'volume_name': 'volume-0a5b3796-46a5-49f9-afd1-4663fc223648', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79745c65-4528-4c70-8cf2-1a43dd28f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79745c65-4528-4c70-8cf2-1a43dd28f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afe0485-cde7-499b-a641-1ef840ee6c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:13 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Volume 0a5b3796-46a5-49f9-afd1-4663fc223648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5b3796-46a5-49f9-afd1-4663fc223648', 'volume_size': 1}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1799101054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5b3796-46a5-49f9-afd1-4663fc223648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:13Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Creating volume 0a5b3796-46a5-49f9-afd1-4663fc223648 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:26:13 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:26:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:13 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=47, name=volume-0a5b3796-46a5-49f9-afd1-4663fc223648, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648 1073741824" returned: 0 in 0.503s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648" returned: 0 in 0.162s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (740ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afe0485-cde7-499b-a641-1ef840ee6c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5b3796-46a5-49f9-afd1-4663fc223648', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e01d17-b9b7-4edb-a221-bf9034438031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:14 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Volume volume-0a5b3796-46a5-49f9-afd1-4663fc223648 (0a5b3796-46a5-49f9-afd1-4663fc223648): created successfully
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e01d17-b9b7-4edb-a221-bf9034438031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (dc8873f0-193e-4767-8512-c68be7063f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e2aecac3-bc24-495a-9f0d-c19b74bb662e tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:26:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-0a5b3796-46a5-49f9-afd1-4663fc223648-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "cinder-0a5b3796-46a5-49f9-afd1-4663fc223648-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Acquiring lock "cinder-quobyte-0a5b3796-46a5-49f9-afd1-4663fc223648" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-0a5b3796-46a5-49f9-afd1-4663fc223648" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b30aa73-8e0a-4a36-8c54-dcf01e9d383b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648" returned: 0 in 0.488s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0a5b3796-46a5-49f9-afd1-4663fc223648" returned: 0 in 0.122s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "cinder-quobyte-0a5b3796-46a5-49f9-afd1-4663fc223648" released by "delete_volume" :: held 0.804s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Created reservations ['1d17203d-7c20-4e34-b8e8-2dcc06f4d0b7', '22db9653-ca7a-4edb-92ce-96b280d82824', 'b795317c-19c9-43af-8da6-a9d373a90db0', 'da8655b6-32e2-4b22-840f-425b1aabada6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.107s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Deleted volume successfully.
Sep 10 17:26:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56b96e14-08bc-401f-8093-433e71a74efb tempest-VolumesActionsTest-988836999 None] Lock "cinder-0a5b3796-46a5-49f9-afd1-4663fc223648-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (302bb5d1-513e-4361-834a-44f339a87240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0d42bb-dec4-4a24-9782-df68f1eed083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0d42bb-dec4-4a24-9782-df68f1eed083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1702546286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:19Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c3c910-6c54-4466-a18d-56b550656d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c3c910-6c54-4466-a18d-56b550656d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965fc89e-78ab-4a95-b61b-ac6a6fdd2d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965fc89e-78ab-4a95-b61b-ac6a6fdd2d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7', 'volume_name': 'volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39589091-654a-4720-a7b8-b96ee6786efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39589091-654a-4720-a7b8-b96ee6786efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e2b4ec-d458-4953-a00c-9c4e9828624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Volume dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7', 'volume_size': 1}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1702546286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892fe7f9851444f5b6bb098236baad72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:19Z,use_quota=True,user_id='7711a339767541e0b3590e321de83662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Creating volume dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:26:19 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:26:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:19 devstack quobyte-client[82918]: System call of process 91450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=48, name=volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:26:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 1073741824" returned: 0 in 0.790s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" returned: 0 in 0.211s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] <== create_volume: return (1176ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:26:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e2b4ec-d458-4953-a00c-9c4e9828624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531101aa-4c6a-4083-848c-5d6bcbc6083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:21 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Volume volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 (dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7): created successfully
Sep 10 17:26:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531101aa-4c6a-4083-848c-5d6bcbc6083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Flow 'volume_create_manager' (302bb5d1-513e-4361-834a-44f339a87240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:21 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bb6eac7a-3c0f-4e78-83e4-9a9485bb6dfc tempest-VolumesActionsTest-1414098508 None] Created volume successfully.
Sep 10 17:26:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:24 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "cinder-quobyte-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-quobyte-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff9ad7-5373-44d7-923c-0e66513c76c7]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" returned: 0 in 0.732s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" returned: 0 in 0.158s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-quobyte-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7" released by "delete_volume" :: held 1.238s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Created reservations ['f665d3ec-ef2b-4875-9b82-38277962a7e5', '792899ec-1383-41da-b76f-3c5924a58fe7', '483c94ce-eed6-44b1-8114-bb6d757f6606', '1746fdeb-4fd4-4dc9-a76c-5079561b8db5'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.148s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Deleted volume successfully.
Sep 10 17:26:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8bd2c72-02dc-4d35-a24f-fae159eaf058 tempest-VolumesActionsTest-1414098508 None] Lock "cinder-dd85ebdb-d004-44c2-8ec6-2fc9ccb03ea7-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:36 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=50,cinder:UPDATE=72,cinder:DELETE=8,cinder:INSERT=13 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=34,cinder:SELECT=27,cinder:INSERT=10,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:26:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Flow 'volume_create_manager' (09427586-ab87-41ff-8e47-170cda130e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689ec9d1-6cbc-4ebf-94eb-bb04bbcb078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689ec9d1-6cbc-4ebf-94eb-bb04bbcb078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1072714038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd41dee5033845ce84e01a0ef54b6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:43Z,use_quota=True,user_id='bd5f7519b5d044a8b3dedd84cd27f8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30782131-1df3-49e4-a846-d4bf6fb12e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30782131-1df3-49e4-a846-d4bf6fb12e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced46161-a953-46d0-8c2e-3cea37db5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced46161-a953-46d0-8c2e-3cea37db5c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0', 'volume_name': 'volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a3c93e-9cc7-4644-a640-5f2d43092a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a3c93e-9cc7-4644-a640-5f2d43092a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9e9041-e3ed-4258-9485-dae775bbcf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:43 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Volume 8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0', 'volume_size': 1}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1072714038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd41dee5033845ce84e01a0ef54b6aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:43Z,use_quota=True,user_id='bd5f7519b5d044a8b3dedd84cd27f8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Creating volume 8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:26:43 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:26:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:44 devstack quobyte-client[82918]: System call of process 91521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:44 devstack quobyte-client[82918]: System call of process 91521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:44 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=49, name=volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:26:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 1073741824" returned: 0 in 0.678s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" returned: 0 in 0.125s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:26:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9e9041-e3ed-4258-9485-dae775bbcf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396ebc99-fce2-4c08-b489-5ec4668c3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:26:45 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Volume volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 (8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0): created successfully
Sep 10 17:26:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396ebc99-fce2-4c08-b489-5ec4668c3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:26:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Flow 'volume_create_manager' (09427586-ab87-41ff-8e47-170cda130e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:26:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-cf24976b-877e-484d-a158-6fd51f1bbab5 tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Created volume successfully.
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Acquiring lock "cinder-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "cinder-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Acquiring lock "cinder-quobyte-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "cinder-quobyte-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" acquired by "delete_volume" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402b1f5-379b-4f68-b254-df0749e1f56f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:26:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:49 devstack quobyte-client[82918]: System call of process 91527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:26:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" returned: 0 in 0.854s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" returned: 0 in 0.217s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "cinder-quobyte-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0" released by "delete_volume" :: held 1.348s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Created reservations ['a3cb113a-1d2d-4501-ad61-d5e25065269a', '227118c1-14c1-477b-80ce-ce1065512414', '9d001cee-818e-4734-a830-3d91c44f9920', '5af016c9-0961-44d8-a62f-df65086f1b4a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.145s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:26:50 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:26:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Deleted volume successfully.
Sep 10 17:26:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5983e47b-e0a1-44b0-8fd3-9ebbcf81133b tempest-VolumeQuotasNegativeTestJSON-1689644739 None] Lock "cinder-8895e1b5-b2ec-4a0a-89e0-5d0ee5ac23e0-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:26:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:26:59 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Flow 'volume_create_manager' (e7c1f44e-dba6-4f2c-8c6d-2feaf9a7e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646fc867-37d3-481e-aa55-9aecc12e0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7ed634d3-aa8f-4f0c-a29f-d9577fc58dd8 req-3cc93132-1442-4b9a-9fae-84162dd1c03b tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646fc867-37d3-481e-aa55-9aecc12e0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-555586922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3cab56-5af4-4213-907c-03119c7869dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2b0cf31314e9ab18cf58919b4d7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:59Z,use_quota=True,user_id='8791ce6a5859480486a4aa1d906fd00a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852fcd79-77f5-4a67-9440-8e32d73b7f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852fcd79-77f5-4a67-9440-8e32d73b7f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a418e65-83a6-49be-aa7a-cc01808dea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a418e65-83a6-49be-aa7a-cc01808dea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3cab56-5af4-4213-907c-03119c7869dc', 'volume_name': 'volume-5c3cab56-5af4-4213-907c-03119c7869dc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262f4021-52ac-4c07-abae-40b6d2ef05f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262f4021-52ac-4c07-abae-40b6d2ef05f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04062c2-bea3-47a0-92d3-a6b0631e1feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Volume 5c3cab56-5af4-4213-907c-03119c7869dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3cab56-5af4-4213-907c-03119c7869dc', 'volume_size': 1}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-555586922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3cab56-5af4-4213-907c-03119c7869dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ef2b0cf31314e9ab18cf58919b4d7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:26:59Z,use_quota=True,user_id='8791ce6a5859480486a4aa1d906fd00a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Creating volume 5c3cab56-5af4-4213-907c-03119c7869dc {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:00 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:00 devstack quobyte-client[82918]: System call of process 91536 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:00 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=50, name=volume-5c3cab56-5af4-4213-907c-03119c7869dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7ed634d3-aa8f-4f0c-a29f-d9577fc58dd8 req-3cc93132-1442-4b9a-9fae-84162dd1c03b tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-7ed634d3-aa8f-4f0c-a29f-d9577fc58dd8 req-3cc93132-1442-4b9a-9fae-84162dd1c03b tempest-AttachVolumeTestJSON-704514118 None] Terminate volume connection completed successfully.
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-7ed634d3-aa8f-4f0c-a29f-d9577fc58dd8 req-3cc93132-1442-4b9a-9fae-84162dd1c03b tempest-AttachVolumeTestJSON-704514118 None] Deleting attachment bfe3d312-f283-46b2-bf43-380ec4d2728b. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc 1073741824" returned: 0 in 0.546s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc" returned: 0 in 0.154s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] <== create_volume: return (761ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04062c2-bea3-47a0-92d3-a6b0631e1feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3cab56-5af4-4213-907c-03119c7869dc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b769278a-a3a5-4e45-b9fa-5edb795c5eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:01 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Volume volume-5c3cab56-5af4-4213-907c-03119c7869dc (5c3cab56-5af4-4213-907c-03119c7869dc): created successfully
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b769278a-a3a5-4e45-b9fa-5edb795c5eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Flow 'volume_create_manager' (e7c1f44e-dba6-4f2c-8c6d-2feaf9a7e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:01 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-58cbd7ad-55c7-42f4-b012-aa25316f2392 tempest-VolumesServicesTestJSON-1284188957 None] Created volume successfully.
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.421s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Acquiring lock "cinder-5c3cab56-5af4-4213-907c-03119c7869dc-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "cinder-5c3cab56-5af4-4213-907c-03119c7869dc-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Acquiring lock "cinder-quobyte-5c3cab56-5af4-4213-907c-03119c7869dc" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "cinder-quobyte-5c3cab56-5af4-4213-907c-03119c7869dc" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c4e354-92b8-4d21-a1a4-6f86a0d9fbcc]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc" returned: 0 in 0.571s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5c3cab56-5af4-4213-907c-03119c7869dc" returned: 0 in 0.172s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "cinder-quobyte-5c3cab56-5af4-4213-907c-03119c7869dc" released by "delete_volume" :: held 0.946s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:03 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Created reservations ['e453e4d2-e3d3-4eaf-93f9-2725c5603e2b', '17988a81-64cf-4c31-a597-ac1f16ec772b', 'a51b4ceb-5171-4f3c-99ce-7c019bcc914c', 'fdc09700-2238-44d5-be15-fe858a7287c4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.112s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:27:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Deleted volume successfully.
Sep 10 17:27:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ea6b3970-e1e2-40f4-b8e3-db31fc6fd43f tempest-VolumesServicesTestJSON-1284188957 None] Lock "cinder-5c3cab56-5af4-4213-907c-03119c7869dc-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:05 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (85040c9a-f5a2-4f84-b591-0d4554ec3ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a448a-c16f-4f2d-8952-e3ea325927d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a448a-c16f-4f2d-8952-e3ea325927d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371825933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343eefdc-45fe-4125-bef7-5e7074314697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229db5acc9834e6394580a02deee10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:05Z,use_quota=True,user_id='fb87187ec7324b6782ef891cd3a02611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f09d77-1bef-4c59-aea5-2d1588ba1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f09d77-1bef-4c59-aea5-2d1588ba1a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cde7fa-b04f-4691-a1d1-0529220359b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cde7fa-b04f-4691-a1d1-0529220359b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343eefdc-45fe-4125-bef7-5e7074314697', 'volume_name': 'volume-343eefdc-45fe-4125-bef7-5e7074314697', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef4462-b12b-4380-a940-38a168969398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ef4462-b12b-4380-a940-38a168969398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fced3d-ad89-45f9-8e72-1a332ed4da72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Volume 343eefdc-45fe-4125-bef7-5e7074314697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343eefdc-45fe-4125-bef7-5e7074314697', 'volume_size': 1}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371825933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343eefdc-45fe-4125-bef7-5e7074314697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229db5acc9834e6394580a02deee10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:05Z,use_quota=True,user_id='fb87187ec7324b6782ef891cd3a02611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Creating volume 343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:06 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:06 devstack quobyte-client[82918]: System call of process 91599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:06 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=51, name=volume-343eefdc-45fe-4125-bef7-5e7074314697, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 1073741824" returned: 0 in 0.549s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697" returned: 0 in 0.212s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] <== create_volume: return (835ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:27:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fced3d-ad89-45f9-8e72-1a332ed4da72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343eefdc-45fe-4125-bef7-5e7074314697', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8643c7-3808-4fc8-909c-9a644dda55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Volume volume-343eefdc-45fe-4125-bef7-5e7074314697 (343eefdc-45fe-4125-bef7-5e7074314697): created successfully
Sep 10 17:27:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8643c7-3808-4fc8-909c-9a644dda55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (85040c9a-f5a2-4f84-b591-0d4554ec3ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e99422ba-8536-470e-bf61-fcd5a600962b tempest-VolumesDeleteCascade-2133084820 None] Created volume successfully.
Sep 10 17:27:08 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Creating offline snapshot b6e95bf9-979a-415d-be05-7eeb520ead18 of volume 343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb2207-b1f7-46d8-9c61-562b786819e3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697" returned: 0 in 0.498s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:09 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=52, name=volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 1G" returned: 0 in 0.332s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img rebase -u -b volume-343eefdc-45fe-4125-bef7-5e7074314697 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:10 devstack quobyte-client[82918]: System call of process 91614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img rebase -u -b volume-343eefdc-45fe-4125-bef7-5e7074314697 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.303s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.111s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.138s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.info" returned: 0 in 0.148s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.info" returned: 0 in 0.142s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4a95ea86-dd46-409a-a6e5-f2df6e454051 tempest-VolumesDeleteCascade-2133084820 None] Create snapshot completed successfully
Sep 10 17:27:12 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Creating offline snapshot 77a20d87-e39f-4335-beae-9f32d51aca8f of volume 343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:27:12 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a162873d-1aad-4333-ad68-93d89b0b305b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:13 devstack quobyte-client[82918]: System call of process 91621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.524s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343eefdc-45fe-4125-bef7-5e7074314697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:13 devstack quobyte-client[82918]: System call of process 91624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:13 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=54, name=volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f 1G" returned: 0 in 0.415s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img rebase -u -b volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:13 devstack quobyte-client[82918]: System call of process 91627 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img rebase -u -b volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 0.230s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 0.141s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.727s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-edc8f42a-b472-4427-84b3-621a5a071152 tempest-VolumesDeleteCascade-2133084820 None] Create snapshot completed successfully
Sep 10 17:27:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Flow 'volume_create_manager' (0b204901-fc24-4dcc-a539-2524da965f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c1f825-32f5-43db-8f0a-0b0d2ab797ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c1f825-32f5-43db-8f0a-0b0d2ab797ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1872261785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5bf5333af944728406e1a23ee29acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:15Z,use_quota=True,user_id='3b77aacfa4a8438c884cf9d26614391f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ae21c-bc21-49df-aa4c-88633c60885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ae21c-bc21-49df-aa4c-88633c60885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970fe1a-089e-4aef-8ddd-5a2c454d2636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970fe1a-089e-4aef-8ddd-5a2c454d2636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b', 'volume_name': 'volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651bd37c-b594-4e31-8802-5fe44c4db984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651bd37c-b594-4e31-8802-5fe44c4db984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbe5f84-cdfd-43d3-acb0-9a293d144424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:15 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume 8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b', 'volume_size': 1}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1872261785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5bf5333af944728406e1a23ee29acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:15Z,use_quota=True,user_id='3b77aacfa4a8438c884cf9d26614391f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Creating volume 8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:15 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:15 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=55, name=volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b 1073741824" returned: 0 in 0.465s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" returned: 0 in 0.196s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] <== create_volume: return (745ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:27:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbe5f84-cdfd-43d3-acb0-9a293d144424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca740906-4f40-4419-b4c7-eebc8477f8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:16 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b (8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b): created successfully
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca740906-4f40-4419-b4c7-eebc8477f8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Flow 'volume_create_manager' (0b204901-fc24-4dcc-a539-2524da965f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-343eefdc-45fe-4125-bef7-5e7074314697-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:16 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4dfa1e13-85d2-4079-87b8-9394c91ec77f tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Created volume successfully.
Sep 10 17:27:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-343eefdc-45fe-4125-bef7-5e7074314697-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Performing cascade delete. {{(pid=82884) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-77a20d87-e39f-4335-beae-9f32d51aca8f-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-77a20d87-e39f-4335-beae-9f32d51aca8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-77a20d87-e39f-4335-beae-9f32d51aca8f" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-77a20d87-e39f-4335-beae-9f32d51aca8f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Deleting offline snapshot 77a20d87-e39f-4335-beae-9f32d51aca8f of volume 343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] snapshot_file for this snap is: volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda22b1-6077-450b-b9cb-2404b21a1430]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Creating offline snapshot f49a6ae4-7858-4c67-828c-eb37a95fa28d of volume 8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[055ae73c-6478-49a3-af42-d151dd5047b8]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:18 devstack quobyte-client[82918]: System call of process 91646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 1.355s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343eefdc-45fe-4125-bef7-5e7074314697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[72207b8b-b012-4c93-b60f-6200984b0f40]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" returned: 0 in 0.853s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=56, name=volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.830s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343eefdc-45fe-4125-bef7-5e7074314697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d 1G" returned: 0 in 0.589s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:20 devstack quobyte-client[82918]: System call of process 91665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "qemu-img rebase -u -b volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 0.386s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 0.716s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 0.333s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:27:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.77a20d87-e39f-4335-beae-9f32d51aca8f" returned: 0 in 0.364s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-77a20d87-e39f-4335-beae-9f32d51aca8f" released by "_delete_snapshot" :: held 3.861s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 0.306s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" released by "delete_snapshot" :: held 4.056s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.info" returned: 0 in 0.504s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.info" returned: 0 in 0.409s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3a91b53e-e708-4c96-b324-84579fa0c5c7 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Create snapshot completed successfully
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['b3832818-7728-40ac-824e-e3b9bdcd1f75', '708c0633-e16e-4b53-b189-e678517e763d', '9a78cb5b-173a-4112-9081-eea34661b04d', '09ad05a3-c6b4-4d3a-8fbd-ba48f6a93b87'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Delete snapshot completed successfully.
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-77a20d87-e39f-4335-beae-9f32d51aca8f-delete_snapshot" released by "delete_snapshot" :: held 5.570s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-b6e95bf9-979a-415d-be05-7eeb520ead18-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-b6e95bf9-979a-415d-be05-7eeb520ead18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:22 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-b6e95bf9-979a-415d-be05-7eeb520ead18" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-b6e95bf9-979a-415d-be05-7eeb520ead18" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Deleting offline snapshot b6e95bf9-979a-415d-be05-7eeb520ead18 of volume 343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:27:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] snapshot_file for this snap is: volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:27:23 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b590a34f-70b2-44f4-b444-94dd411b7580]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 1.307s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343eefdc-45fe-4125-bef7-5e7074314697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf63e7-f434-4878-817f-49f5c0d9083b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "cinder-f49a6ae4-7858-4c67-828c-eb37a95fa28d-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-f49a6ae4-7858-4c67-828c-eb37a95fa28d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.458s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" acquired by "delete_snapshot" :: waited 0.081s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "cinder-quobyte-f49a6ae4-7858-4c67-828c-eb37a95fa28d" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-f49a6ae4-7858-4c67-828c-eb37a95fa28d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Deleting offline snapshot f49a6ae4-7858-4c67-828c-eb37a95fa28d of volume 8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] snapshot_file for this snap is: volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[621be2a3-6d49-494c-854c-cf2ec44c1ba0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:26 devstack quobyte-client[82918]: System call of process 91725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697" returned: 0 in 2.237s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.618s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:27 devstack quobyte-client[82918]: System call of process 91745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 1.689s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697.b6e95bf9-979a-415d-be05-7eeb520ead18" returned: 0 in 0.597s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[483680f0-2731-4a55-995a-bbfe773cfdd0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-b6e95bf9-979a-415d-be05-7eeb520ead18" released by "_delete_snapshot" :: held 5.729s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" released by "delete_snapshot" :: held 5.864s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:29 devstack quobyte-client[82918]: System call of process 91756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" returned: 0 in 1.161s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:30 devstack quobyte-client[82918]: System call of process 91763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['548d1eab-44a0-43f5-86bb-95bc3777617a', 'c204c613-ba1c-47e3-a1ad-4716bf542b69', '28e071d0-70a7-4637-9191-7af0f58584ee', 'ee9caa65-1e49-468e-bc44-aa4f6f39370b'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 0.799s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b.f49a6ae4-7858-4c67-828c-eb37a95fa28d" returned: 0 in 0.386s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-f49a6ae4-7858-4c67-828c-eb37a95fa28d" released by "_delete_snapshot" :: held 4.508s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" released by "delete_snapshot" :: held 4.562s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:31 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Delete snapshot completed successfully.
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-b6e95bf9-979a-415d-be05-7eeb520ead18-delete_snapshot" released by "delete_snapshot" :: held 8.438s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Snapshots deleted, issuing volume delete {{(pid=82884) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d4d9f-6831-4c4f-9cd2-22547d47a98b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:31 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Created reservations ['bef03bff-222e-45c8-8e58-ff5b6bbafdb3', '0b6a30e3-e103-4411-961d-07a25329a61b', '0092f166-8f47-4df3-bac4-a46491d7bcc2', '3ea0c676-1abe-4665-98a5-62ea1ae1dd23'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:31 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Delete snapshot completed successfully.
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-42110150-b4a4-4d01-abef-59e5f526c3e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-f49a6ae4-7858-4c67-828c-eb37a95fa28d-delete_snapshot" released by "delete_snapshot" :: held 5.797s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697" returned: 0 in 0.681s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-343eefdc-45fe-4125-bef7-5e7074314697" returned: 0 in 0.158s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-343eefdc-45fe-4125-bef7-5e7074314697" released by "delete_volume" :: held 1.072s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "cinder-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['8961461c-0140-4518-8ead-3deef167163b', 'f6efdaea-219d-4d11-aed2-7fa134d611d9', 'eff35cf7-87c7-4326-a238-30e18fbea526', 'da875c9e-e72e-4762-858b-027bc420af71'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6471e4-a23f-43d2-9f40-5d50f9f48a6c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.190s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:33 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:27:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Deleted volume successfully.
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" returned: 0 in 1.177s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" returned: 0 in 0.200s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1f7dcd32-b791-4811-ae7c-091b198afc2c tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-343eefdc-45fe-4125-bef7-5e7074314697-delete_volume" released by "delete_volume" :: held 17.695s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-quobyte-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b" released by "delete_volume" :: held 1.548s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:34 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Created reservations ['94921b29-b5ec-42bd-ab9b-a4cd45329494', 'fdc80a63-b314-4aca-ad3e-e2bcdc9003c3', 'addab335-0df3-4991-8189-201a048f424a', '7fb2fa60-f148-44d3-9cc6-1f4ab568d8be'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.149s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:35 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:27:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Deleted volume successfully.
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b3a47187-9603-4226-a989-18785f14cf66 tempest-VolumeSnapshotQuotasNegativeTestJSON-789573401 None] Lock "cinder-8fe7cb9b-1d30-4766-ab5d-7232d1f79e2b-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (81a19cc9-27b4-4ef7-bd56-8c88bcc75a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88be12e4-e758-49b1-8891-93cf85a6a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88be12e4-e758-49b1-8891-93cf85a6a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1525579368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c8da7b-a0a3-4009-9065-8a7ace3b1da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229db5acc9834e6394580a02deee10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:36Z,use_quota=True,user_id='fb87187ec7324b6782ef891cd3a02611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9507b60-5485-4bb4-8e60-28042f1039a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9507b60-5485-4bb4-8e60-28042f1039a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11774335-982d-45a4-ab95-a86158699e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11774335-982d-45a4-ab95-a86158699e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c8da7b-a0a3-4009-9065-8a7ace3b1da4', 'volume_name': 'volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7d4838-f7f8-4a1c-ad2b-bbfeacb9c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7d4838-f7f8-4a1c-ad2b-bbfeacb9c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e714f451-ede0-47d4-923c-381956ed4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:36 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Volume 12c8da7b-a0a3-4009-9065-8a7ace3b1da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4', 'volume_size': 1}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1525579368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c8da7b-a0a3-4009-9065-8a7ace3b1da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229db5acc9834e6394580a02deee10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:36Z,use_quota=True,user_id='fb87187ec7324b6782ef891cd3a02611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Creating volume 12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:36 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:36 devstack quobyte-client[82918]: System call of process 91789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:36 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=58, name=volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 1073741824" returned: 0 in 0.489s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.120s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e714f451-ede0-47d4-923c-381956ed4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d60b14f-8a2f-46f7-a29e-012578acd2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:37 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Volume volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 (12c8da7b-a0a3-4009-9065-8a7ace3b1da4): created successfully
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d60b14f-8a2f-46f7-a29e-012578acd2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (81a19cc9-27b4-4ef7-bd56-8c88bcc75a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:37 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=47,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:27:37 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-37d833de-5770-4187-8a71-fe11d59a3758 tempest-VolumesDeleteCascade-2133084820 None] Created volume successfully.
Sep 10 17:27:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Creating offline snapshot 67578900-2fb1-411a-b04c-12ca800b1a13 of volume 12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:27:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d1973-6de6-453b-ae46-d80f1a21f97d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:39 devstack quobyte-client[82918]: System call of process 91805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.878s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:40 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=59, name=volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 1G" returned: 0 in 0.517s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img rebase -u -b volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img rebase -u -b volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.225s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.144s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:27:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.136s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.info" returned: 0 in 0.166s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.info" returned: 0 in 0.118s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-31a2b27b-445a-4496-a751-4b5e4c0571eb tempest-VolumesDeleteCascade-2133084820 None] Create snapshot completed successfully
Sep 10 17:27:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (fe32b324-a482-4be8-b971-57696816105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1de84f9-ba47-4447-91ce-10809d56137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1de84f9-ba47-4447-91ce-10809d56137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132759277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8776e171-411b-44be-9644-dd50ef031c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229db5acc9834e6394580a02deee10de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67578900-2fb1-411a-b04c-12ca800b1a13,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:43Z,use_quota=True,user_id='fb87187ec7324b6782ef891cd3a02611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98af94-a0cd-482a-a8b3-14e5f012302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e98af94-a0cd-482a-a8b3-14e5f012302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e8ad5-2dc7-4582-8e80-4b3249849fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e8ad5-2dc7-4582-8e80-4b3249849fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8776e171-411b-44be-9644-dd50ef031c97', 'volume_name': 'volume-8776e171-411b-44be-9644-dd50ef031c97', 'volume_size': 1, 'snapshot_id': '67578900-2fb1-411a-b04c-12ca800b1a13'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f409a90-cf0c-4183-80aa-88d35360c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f409a90-cf0c-4183-80aa-88d35360c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b8329e-1479-4308-b6d2-79e6c94ece18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:43 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Volume 8776e171-411b-44be-9644-dd50ef031c97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8776e171-411b-44be-9644-dd50ef031c97', 'volume_size': 1, 'snapshot_id': '67578900-2fb1-411a-b04c-12ca800b1a13'}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13-8776e171-411b-44be-9644-dd50ef031c97" by "_create_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13-8776e171-411b-44be-9644-dd50ef031c97" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Creating volume 8776e171-411b-44be-9644-dd50ef031c97 from snapshot 67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" by "_copy_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] snapshot: 67578900-2fb1-411a-b04c-12ca800b1a13, volume: 8776e171-411b-44be-9644-dd50ef031c97,  {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4487ea78-cf1c-4a2d-a847-d92244f7400d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:44 devstack quobyte-client[82918]: System call of process 91839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.588s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Creating direct copy from snapshot {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d6305-154e-46ec-8c97-85b4506659be]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.693s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:45 devstack cinder-volume[82884]: DEBUG cinder.utils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 not found in is_blk_device check {{(pid=82884) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 17:27:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:45 devstack quobyte-client[82918]: System call of process 91846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:45 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=61, name=volume-8776e171-411b-44be-9644-dd50ef031c97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:53 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=56,cinder:DELETE=7,cinder:SELECT=50,cinder:INSERT=12 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:27:53 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:27:54 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:54 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (2ae23e3f-55db-4f05-bc73-d5f5bc715640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432a170c-f247-46fc-88cf-9ee2eff35014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432a170c-f247-46fc-88cf-9ee2eff35014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-663673492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c566e06-42af-4ad6-b998-d2abfbdcfe40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:52Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a4b413-30a9-485a-901c-12d712e97965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a4b413-30a9-485a-901c-12d712e97965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2904fdd5-130e-46c6-9318-e2bd5f6bc5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2904fdd5-130e-46c6-9318-e2bd5f6bc5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c566e06-42af-4ad6-b998-d2abfbdcfe40', 'volume_name': 'volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eddeecd-1539-42fc-b088-9053a6da5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eddeecd-1539-42fc-b088-9053a6da5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b183cca-5f30-43b3-8422-1fb9b8068ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:55 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Volume 4c566e06-42af-4ad6-b998-d2abfbdcfe40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40', 'volume_size': 1}
Sep 10 17:27:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97" returned: 0 in 10.919s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a92df8-13c4-46d3-90ac-ad79fed9cbee]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.639s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4, size 1024.00 MB, duration 10.92 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:27:56 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Converted 1024.00 MB image at 93.74 MB/s
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:27:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97" returned: 0 in 0.101s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" released by "_copy_volume_from_snapshot" :: held 13.308s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13-8776e171-411b-44be-9644-dd50ef031c97" released by "_create_volume_from_snapshot" :: held 13.359s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.389s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-663673492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c566e06-42af-4ad6-b998-d2abfbdcfe40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:27:52Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Creating volume 4c566e06-42af-4ad6-b998-d2abfbdcfe40 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:27:57 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:27:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:57 devstack quobyte-client[82918]: System call of process 91861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:27:57 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=62, name=volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b8329e-1479-4308-b6d2-79e6c94ece18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8776e171-411b-44be-9644-dd50ef031c97', 'volume_size': 1, 'snapshot_id': '67578900-2fb1-411a-b04c-12ca800b1a13'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eafc89-c2ac-479c-8338-a42e3311f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 1073741824" returned: 0 in 0.642s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:27:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Volume volume-8776e171-411b-44be-9644-dd50ef031c97 (8776e171-411b-44be-9644-dd50ef031c97): created successfully
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eafc89-c2ac-479c-8338-a42e3311f440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Flow 'volume_create_manager' (fe32b324-a482-4be8-b971-57696816105d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40" returned: 0 in 0.244s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] <== create_volume: return (927ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b183cca-5f30-43b3-8422-1fb9b8068ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78309b8e-0b92-404e-83b6-0ea87114728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:27:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b9a85421-e103-46f4-a627-30f2c92cf99f tempest-VolumesDeleteCascade-2133084820 None] Created volume successfully.
Sep 10 17:27:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Volume volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 (4c566e06-42af-4ad6-b998-d2abfbdcfe40): created successfully
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78309b8e-0b92-404e-83b6-0ea87114728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:27:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (2ae23e3f-55db-4f05-bc73-d5f5bc715640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:27:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9790272e-7f89-4289-8acc-c66122b80a08 tempest-VolumesListAdminTestJSON-1832532161 None] Created volume successfully.
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-12c8da7b-a0a3-4009-9065-8a7ace3b1da4-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-12c8da7b-a0a3-4009-9065-8a7ace3b1da4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Performing cascade delete. {{(pid=82884) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-67578900-2fb1-411a-b04c-12ca800b1a13-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-67578900-2fb1-411a-b04c-12ca800b1a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Deleting offline snapshot 67578900-2fb1-411a-b04c-12ca800b1a13 of volume 12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] snapshot_file for this snap is: volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[755af1d6-6a27-4161-a8d0-074c1c834e71]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:27:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:00 devstack quobyte-client[82918]: System call of process 91866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.842s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:28:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (0170ee5b-affa-4c0d-a95a-d6949e1754e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b586c682-7d18-4f9c-b245-d6f432ad7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0be17-10bd-477e-aeda-4377eb52c57e]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b586c682-7d18-4f9c-b245-d6f432ad7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-544313300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b1dd07-65d0-4800-a431-791183571b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:00Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33416cf-3519-4d70-8001-c7f8c30ab572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33416cf-3519-4d70-8001-c7f8c30ab572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09adeb7b-c774-4545-9e03-fc82e869ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09adeb7b-c774-4545-9e03-fc82e869ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b1dd07-65d0-4800-a431-791183571b85', 'volume_name': 'volume-d3b1dd07-65d0-4800-a431-791183571b85', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ef4387-8fbe-4137-9318-64c5a1beab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ef4387-8fbe-4137-9318-64c5a1beab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e749446-46a5-4f8c-8939-ab0c5f55ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Volume d3b1dd07-65d0-4800-a431-791183571b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b1dd07-65d0-4800-a431-791183571b85', 'volume_size': 1}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-544313300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b1dd07-65d0-4800-a431-791183571b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:00Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Creating volume d3b1dd07-65d0-4800-a431-791183571b85 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:28:00 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:28:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:01 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=63, name=volume-d3b1dd07-65d0-4800-a431-791183571b85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.916s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85 1073741824" returned: 0 in 0.809s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.450s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.418s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85" returned: 0 in 0.363s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] <== create_volume: return (1262ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4.67578900-2fb1-411a-b04c-12ca800b1a13" returned: 0 in 0.365s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-67578900-2fb1-411a-b04c-12ca800b1a13" released by "_delete_snapshot" :: held 2.968s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" released by "delete_snapshot" :: held 3.016s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e749446-46a5-4f8c-8939-ab0c5f55ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b1dd07-65d0-4800-a431-791183571b85', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318048eb-980b-416e-8fbf-7a3c765fffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Volume volume-d3b1dd07-65d0-4800-a431-791183571b85 (d3b1dd07-65d0-4800-a431-791183571b85): created successfully
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318048eb-980b-416e-8fbf-7a3c765fffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (0170ee5b-affa-4c0d-a95a-d6949e1754e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d3690260-6f72-476a-8d9b-4a31586ae146 tempest-VolumesListAdminTestJSON-1832532161 None] Created volume successfully.
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['613f5ab8-35e1-4f70-9643-24e52e55954e', '9052b0d6-c8b5-4d7b-a922-6a596a68370b', 'cfdb0525-ff8d-4805-aaa3-510468de969a', '8bb83caa-bced-421f-9421-55a6f200cc4d'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Delete snapshot completed successfully.
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-67578900-2fb1-411a-b04c-12ca800b1a13-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Snapshots deleted, issuing volume delete {{(pid=82884) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" acquired by "delete_volume" :: waited 0.010s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd573db-9243-41b9-bf26-826ebd57b4ff]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.467s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" returned: 0 in 0.128s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-12c8da7b-a0a3-4009-9065-8a7ace3b1da4" released by "delete_volume" :: held 0.815s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (28f6f08a-c8b8-43e6-a2ed-5ef28f52ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1909c8-52b9-43a2-b6ce-bc27cfe95da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1909c8-52b9-43a2-b6ce-bc27cfe95da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-713783226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef106e7-9e21-413e-9ca5-8114ac2765e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:04Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7f81a6-cfd3-425c-aeca-b43566f5c977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7f81a6-cfd3-425c-aeca-b43566f5c977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90be61ea-475f-4e96-9eda-a1a4c8e3d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90be61ea-475f-4e96-9eda-a1a4c8e3d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef106e7-9e21-413e-9ca5-8114ac2765e3', 'volume_name': 'volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acf2689-e78a-4e29-8e65-3ef3332a4eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acf2689-e78a-4e29-8e65-3ef3332a4eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a902922-0c17-4b2c-9100-e6c96d9dad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:04 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Volume 0ef106e7-9e21-413e-9ca5-8114ac2765e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3', 'volume_size': 1}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-713783226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef106e7-9e21-413e-9ca5-8114ac2765e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b4ea5bd297431aa2a1f788f1d05531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:04Z,use_quota=True,user_id='fed620ec073e4667b387db51b65163eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Creating volume 0ef106e7-9e21-413e-9ca5-8114ac2765e3 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:28:04 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:04 devstack quobyte-client[82918]: System call of process 91896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:04 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=64, name=volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 1073741824" returned: 0 in 0.428s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['c3804f87-1994-4aed-8fb4-85512c6798be', '7ef3fa61-0c06-4fa4-a1f2-6eef7c9f58b1', 'c186d106-e93e-48d7-807f-8833cd653be2', '0b72dad0-84b3-4ac4-88ce-7cee45ede39a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3" returned: 0 in 0.431s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] <== create_volume: return (889ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a902922-0c17-4b2c-9100-e6c96d9dad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b4ffc2-0fd9-46bb-a3a2-e47b86b803d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:05 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Volume volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 (0ef106e7-9e21-413e-9ca5-8114ac2765e3): created successfully
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b4ffc2-0fd9-46bb-a3a2-e47b86b803d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Flow 'volume_create_manager' (28f6f08a-c8b8-43e6-a2ed-5ef28f52ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.294s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Deleted volume successfully.
Sep 10 17:28:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8611b413-f479-465d-a02e-a24d8c6fc594 tempest-VolumesListAdminTestJSON-1832532161 None] Created volume successfully.
Sep 10 17:28:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-adb6079a-02dd-4fff-b81c-aeba97632e57 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-12c8da7b-a0a3-4009-9065-8a7ace3b1da4-delete_volume" released by "delete_volume" :: held 6.706s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-8776e171-411b-44be-9644-dd50ef031c97-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-8776e171-411b-44be-9644-dd50ef031c97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:06 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a34feb-39c0-4a9d-a3a6-2ecd5da785be]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:07 devstack quobyte-client[82918]: System call of process 91902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97" returned: 0 in 0.677s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8776e171-411b-44be-9644-dd50ef031c97" returned: 0 in 0.400s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Flow 'volume_create_manager' (4bec977f-abc4-44ca-8a1e-e7ab9d010676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8701c1c0-e35e-4e88-bca9-31153ca690c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-quobyte-8776e171-411b-44be-9644-dd50ef031c97" released by "delete_volume" :: held 1.421s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8701c1c0-e35e-4e88-bca9-31153ca690c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef17037-156c-486f-b58e-bd14ff5b1473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efacf7d447e4a3a92f81db85c23c7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:07Z,use_quota=True,user_id='963c86bd18c140ebb8326e8b28340d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f627d-9afa-44d3-89a4-d012daddecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f627d-9afa-44d3-89a4-d012daddecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf65a15-f012-4fe9-afef-ef095e1bf460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf65a15-f012-4fe9-afef-ef095e1bf460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef17037-156c-486f-b58e-bd14ff5b1473', 'volume_name': 'volume-0ef17037-156c-486f-b58e-bd14ff5b1473', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8611c631-9f37-4cf7-be5b-5eaf29adb538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8611c631-9f37-4cf7-be5b-5eaf29adb538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f853e7-fc27-4d84-a0df-0a15318003b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:08 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Volume 0ef17037-156c-486f-b58e-bd14ff5b1473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef17037-156c-486f-b58e-bd14ff5b1473', 'volume_size': 1}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef17037-156c-486f-b58e-bd14ff5b1473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efacf7d447e4a3a92f81db85c23c7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:07Z,use_quota=True,user_id='963c86bd18c140ebb8326e8b28340d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Creating volume 0ef17037-156c-486f-b58e-bd14ff5b1473 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:28:08 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:08 devstack quobyte-client[82918]: System call of process 91906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:08 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=65, name=volume-0ef17037-156c-486f-b58e-bd14ff5b1473, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473 1073741824" returned: 0 in 0.518s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473" returned: 0 in 0.206s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:28:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Created reservations ['f2d7bd2e-dd79-45c8-abce-d4c8cffbc29c', '64f364b6-4ba7-41af-b25a-dbd81a7e55b6', 'e4ab5811-d291-4389-8a5d-8114e1234a15', 'c511876f-a6f5-427c-aa5a-25e550b1de63'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f853e7-fc27-4d84-a0df-0a15318003b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef17037-156c-486f-b58e-bd14ff5b1473', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f12d949-e495-4987-83bf-4a0720cbf191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:09 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Volume volume-0ef17037-156c-486f-b58e-bd14ff5b1473 (0ef17037-156c-486f-b58e-bd14ff5b1473): created successfully
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f12d949-e495-4987-83bf-4a0720cbf191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Flow 'volume_create_manager' (4bec977f-abc4-44ca-8a1e-e7ab9d010676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ad70d14f-9c5a-46d5-b4b3-eb015cdce442 tempest-VolumesListAdminTestJSON-1952676795 None] Created volume successfully.
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.122s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Deleted volume successfully.
Sep 10 17:28:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3d3d0cc7-7c0e-463e-8f2e-54d2555aaa35 tempest-VolumesDeleteCascade-2133084820 None] Lock "cinder-8776e171-411b-44be-9644-dd50ef031c97-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Acquiring lock "cinder-0ef17037-156c-486f-b58e-bd14ff5b1473-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "cinder-0ef17037-156c-486f-b58e-bd14ff5b1473-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-0ef106e7-9e21-413e-9ca5-8114ac2765e3-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-0ef106e7-9e21-413e-9ca5-8114ac2765e3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Acquiring lock "cinder-quobyte-0ef17037-156c-486f-b58e-bd14ff5b1473" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "cinder-quobyte-0ef17037-156c-486f-b58e-bd14ff5b1473" acquired by "delete_volume" :: waited 0.035s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c54d548-354f-4493-9887-26772806119a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:10 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-quobyte-0ef106e7-9e21-413e-9ca5-8114ac2765e3" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-0ef106e7-9e21-413e-9ca5-8114ac2765e3" acquired by "delete_volume" :: waited 0.264s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fec3cc-1ab6-425b-ada8-f71b42380448]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473" returned: 0 in 0.815s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef17037-156c-486f-b58e-bd14ff5b1473" returned: 0 in 0.348s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "cinder-quobyte-0ef17037-156c-486f-b58e-bd14ff5b1473" released by "delete_volume" :: held 1.459s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3" returned: 0 in 1.208s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0ef106e7-9e21-413e-9ca5-8114ac2765e3" returned: 0 in 0.445s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Created reservations ['d5730edd-db34-4f9d-8557-c4eafb9f44c4', '84e54f09-e895-49a3-8543-3e041c1df972', 'ecbdfe97-ebe8-496d-a6c4-a731e1b140d5', 'bb9f2a71-0ae5-4fec-b26a-bcfe221df8c8'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-0ef106e7-9e21-413e-9ca5-8114ac2765e3" released by "delete_volume" :: held 2.012s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Created reservations ['2f2ad68a-7d4d-4d4d-9152-afdc359f5dff', '1973bde9-6677-48fc-bdf0-2bb8b2cea185', 'b4e76ba8-20e3-4589-b670-1604bc20f343', '772f7178-7422-425b-8127-283cb2b90feb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.323s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Deleted volume successfully.
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-aabc3ea6-cc12-4cc4-bbc6-e864b0a5f313 tempest-VolumesListAdminTestJSON-1952676795 None] Lock "cinder-0ef17037-156c-486f-b58e-bd14ff5b1473-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.228s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Deleted volume successfully.
Sep 10 17:28:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5ad7461-89ac-41f6-8ca4-64c8e3111f80 tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-0ef106e7-9e21-413e-9ca5-8114ac2765e3-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-d3b1dd07-65d0-4800-a431-791183571b85-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-d3b1dd07-65d0-4800-a431-791183571b85-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-quobyte-d3b1dd07-65d0-4800-a431-791183571b85" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-d3b1dd07-65d0-4800-a431-791183571b85" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b25db65-5e0f-4c88-b6d9-cfba1be21e99]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85" returned: 0 in 0.560s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3b1dd07-65d0-4800-a431-791183571b85" returned: 0 in 0.107s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-d3b1dd07-65d0-4800-a431-791183571b85" released by "delete_volume" :: held 0.830s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Created reservations ['6588637e-4d90-4ee4-b136-8614ccf3f2ab', '677eaa65-1f72-4f74-b995-579e415f3e5a', 'c04db423-9bae-496d-a948-a74f75cbb1fb', '0a3941a9-56c8-4d2a-8a19-32c60e4c58ac'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.097s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:15 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Deleted volume successfully.
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-784cc3da-13b2-49e5-b69a-3072ab2c807a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-d3b1dd07-65d0-4800-a431-791183571b85-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Flow 'volume_create_manager' (9ee63648-051e-4fce-aadc-eec927e7157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad712b36-da0e-4ca5-a9e3-808af9865271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad712b36-da0e-4ca5-a9e3-808af9865271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1716221684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0871f73b224ca3a775fba1bdf7b90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:16Z,use_quota=True,user_id='a1a7131ae617423993bb416daf29260c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6fe461-4b95-47dd-bdc6-ef1cc77b81b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6fe461-4b95-47dd-bdc6-ef1cc77b81b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5550dc0-8869-476f-9226-046df2d11219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5550dc0-8869-476f-9226-046df2d11219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04', 'volume_name': 'volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9131bd-41a8-4acb-9c7d-eff31b27bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9131bd-41a8-4acb-9c7d-eff31b27bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fab599-db28-4d9a-a90b-6b6de9dca9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:16 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Volume 0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04', 'volume_size': 1}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1716221684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0871f73b224ca3a775fba1bdf7b90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:16Z,use_quota=True,user_id='a1a7131ae617423993bb416daf29260c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Creating volume 0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:28:16 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:16 devstack quobyte-client[82918]: System call of process 91929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-4c566e06-42af-4ad6-b998-d2abfbdcfe40-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:16 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=66, name=volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-4c566e06-42af-4ad6-b998-d2abfbdcfe40-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "cinder-quobyte-4c566e06-42af-4ad6-b998-d2abfbdcfe40" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-4c566e06-42af-4ad6-b998-d2abfbdcfe40" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64f7f89-f1c2-4dd8-97e1-24688171ee5c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 1073741824" returned: 0 in 0.739s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" returned: 0 in 0.134s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] <== create_volume: return (945ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fab599-db28-4d9a-a90b-6b6de9dca9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f8f4e-c971-4dfb-a40c-ea3b8f36aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Volume volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 (0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04): created successfully
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02f8f4e-c971-4dfb-a40c-ea3b8f36aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Flow 'volume_create_manager' (9ee63648-051e-4fce-aadc-eec927e7157b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:17 devstack quobyte-client[82918]: System call of process 91933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ac0e2037-6c8e-4ca7-b0b9-817fcefe7ef1 tempest-VolumesNegativeTest-288631521 None] Created volume successfully.
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40" returned: 0 in 0.634s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4c566e06-42af-4ad6-b998-d2abfbdcfe40" returned: 0 in 0.169s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-quobyte-4c566e06-42af-4ad6-b998-d2abfbdcfe40" released by "delete_volume" :: held 0.977s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Created reservations ['02879c5b-6263-4912-8cf6-63cf52dc4b5c', 'f8d29f5e-422c-47d9-b025-bd52359fe42c', '6ddc1c96-4c33-47eb-a07a-7eb3992d1973', 'ca9145d2-a1b1-406d-a071-0bf746ed83fa'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.259s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Deleted volume successfully.
Sep 10 17:28:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-21f68370-d1d1-4e47-9d2b-1fab5814f92a tempest-VolumesListAdminTestJSON-1832532161 None] Lock "cinder-4c566e06-42af-4ad6-b998-d2abfbdcfe40-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Flow 'volume_create_manager' (5435a42a-f146-4c3c-a468-b313bc3bf193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8683123-784d-4b01-9f1c-02e9e35d5b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8683123-784d-4b01-9f1c-02e9e35d5b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1066485793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f705a8-f7bf-49af-a549-df555cd7860b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955311a8e3194b3f947c5534a5547b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:28Z,use_quota=True,user_id='9875fdf1295d430e9ccdd685d8860a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57804c-872e-4ffd-8eac-97e6985c6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57804c-872e-4ffd-8eac-97e6985c6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e830092-66f5-406f-b250-243f9ff13df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e830092-66f5-406f-b250-243f9ff13df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96f705a8-f7bf-49af-a549-df555cd7860b', 'volume_name': 'volume-96f705a8-f7bf-49af-a549-df555cd7860b', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039856d750>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6b6450-6fdf-425b-921f-d056624c784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6b6450-6fdf-425b-921f-d056624c784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc944d87-507c-4bff-ab40-4cad8188e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Volume 96f705a8-f7bf-49af-a549-df555cd7860b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96f705a8-f7bf-49af-a549-df555cd7860b', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039856d750>}
Sep 10 17:28:29 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Cloning 96f705a8-f7bf-49af-a549-df555cd7860b from image 3a863299-f273-4a78-81cf-9aa7d2a025e9  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:28:30 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD, size 20.69 MB, duration 1.24 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:28:30 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Image download 20.69 MB at 16.65 MB/s
Sep 10 17:28:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad028b8-5bee-4795-8f51-f6248e2d510f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:31 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD
Sep 10 17:28:31 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:28:34 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Sep 10 17:28:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD" returned: 0 in 4.484s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:34 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 is fetched for user 9875fdf1295d430e9ccdd685d8860a53. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:28:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[672eb222-a853-45e3-938d-e3b99332b4f0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:35 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD
Sep 10 17:28:35 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:28:37 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD" returned: 0 in 2.595s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1066485793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f705a8-f7bf-49af-a549-df555cd7860b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955311a8e3194b3f947c5534a5547b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:28:28Z,use_quota=True,user_id='9875fdf1295d430e9ccdd685d8860a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Creating volume 96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:28:38 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:38 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=67, name=volume-96f705a8-f7bf-49af-a549-df555cd7860b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b 1073741824" returned: 0 in 0.472s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 0 in 0.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:38 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Attempting download of 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 96f705a8-f7bf-49af-a549-df555cd7860b. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:28:39 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbb1c2-4a23-4c19-ad2c-a5daf79a6a59]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_apa7vwqi {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_apa7vwqi" returned: 0 in 0.533s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_apa7vwqi {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_apa7vwqi" returned: 1 in 0.622s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_apa7vwqi' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:28:40 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9404f24b-abe5-46bf-8a0c-52d61d46004d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:41 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] 3a863299-f273-4a78-81cf-9aa7d2a025e9 was qcow2, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:28:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:42 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=67, name=volume-96f705a8-f7bf-49af-a549-df555cd7860b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:28:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 0 in 2.724s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:44 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_1rvq4b_qdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:28:44 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Converted 112.00 MB image at 40.07 MB/s
Sep 10 17:28:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b 1G" returned: 0 in 0.691s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:45 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=45,cinder:SELECT=43,cinder:DELETE=8,cinder:INSERT=12 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:28:45 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de3a8d-23c4-4d2d-8cf8-25782e7da2f5]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:48 devstack quobyte-client[82918]: System call of process 92156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 0 in 2.321s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:49 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=89,cinder:SELECT=43,cinder:INSERT=17,cinder:DELETE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:28:49 devstack quobyte-client[82918]: System call of process 92179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:28:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 1 in 1.605s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:28:49 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Downloaded image 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 96f705a8-f7bf-49af-a549-df555cd7860b successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:28:49 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 for user 9875fdf1295d430e9ccdd685d8860a53 is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:28:50 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Marking volume 96f705a8-f7bf-49af-a549-df555cd7860b as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:28:50 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Copying metadata from image 3a863299-f273-4a78-81cf-9aa7d2a025e9 to 96f705a8-f7bf-49af-a549-df555cd7860b. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:28:50 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Creating volume glance metadata for volume 96f705a8-f7bf-49af-a549-df555cd7860b backed by image 3a863299-f273-4a78-81cf-9aa7d2a025e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:28:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc944d87-507c-4bff-ab40-4cad8188e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f705a8-f7bf-49af-a549-df555cd7860b', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039856d750>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf61739d-b1b0-408b-b8dc-660e3521f023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:28:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Volume volume-96f705a8-f7bf-49af-a549-df555cd7860b (96f705a8-f7bf-49af-a549-df555cd7860b): created successfully
Sep 10 17:28:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf61739d-b1b0-408b-b8dc-660e3521f023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:28:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Flow 'volume_create_manager' (5435a42a-f146-4c3c-a468-b313bc3bf193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:28:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d5b8620a-671a-41da-800a-1534dbc13fe9 tempest-VolumesImageMetadata-2062718827 None] Created volume successfully.
Sep 10 17:28:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Acquiring lock "cinder-96f705a8-f7bf-49af-a549-df555cd7860b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "cinder-96f705a8-f7bf-49af-a549-df555cd7860b-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:28:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Acquiring lock "cinder-quobyte-96f705a8-f7bf-49af-a549-df555cd7860b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:28:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "cinder-quobyte-96f705a8-f7bf-49af-a549-df555cd7860b" acquired by "delete_volume" :: waited 0.039s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:28:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47e66c-3b6b-4a02-aaaf-92ff7b223863]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:28:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 0 in 0.976s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 1 in 1.407s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:28:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-96f705a8-f7bf-49af-a549-df555cd7860b" returned: 0 in 0.185s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "cinder-quobyte-96f705a8-f7bf-49af-a549-df555cd7860b" released by "delete_volume" :: held 3.127s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:28:57 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Created reservations ['8a73f64d-123f-4c07-bf1c-fe69ce0a2efa', '36e1adfe-7adf-4ea7-a70a-d37b7893e0eb', '4bbbea6c-5219-42f3-8083-4174ce863c8d', '64d57baa-9827-40ba-bbb7-47ce0fafd11a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.049s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:28:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.319s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:28:59 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:28:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Deleted volume successfully.
Sep 10 17:29:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bcc60010-784e-48c5-999a-69692a9eb694 tempest-VolumesImageMetadata-2062718827 None] Lock "cinder-96f705a8-f7bf-49af-a549-df555cd7860b-delete_volume" released by "delete_volume" :: held 6.490s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.150s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:29:06 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Flow 'volume_create_manager' (30dd969d-1c87-4ca6-b311-da5130b66793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950626aa-9c11-43bf-97cd-5eaf32f21279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950626aa-9c11-43bf-97cd-5eaf32f21279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1514072392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e045f-1efc-46a0-bc0a-8630d5990c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3650ddfd592740789638c28fa56230d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:06Z,use_quota=True,user_id='90455116a57641dcb5f2e71977e2a3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a15da1-ffae-4a9f-80fc-478f842ce143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a15da1-ffae-4a9f-80fc-478f842ce143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34206bc1-8063-42ac-b0ea-0c2098179c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34206bc1-8063-42ac-b0ea-0c2098179c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41e045f-1efc-46a0-bc0a-8630d5990c8f', 'volume_name': 'volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6adab3b-212c-46b4-b5a5-c8372b25d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6adab3b-212c-46b4-b5a5-c8372b25d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca115091-101f-4d18-a1ba-6aa690a18dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Volume a41e045f-1efc-46a0-bc0a-8630d5990c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f', 'volume_size': 1}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1514072392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e045f-1efc-46a0-bc0a-8630d5990c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3650ddfd592740789638c28fa56230d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:06Z,use_quota=True,user_id='90455116a57641dcb5f2e71977e2a3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Creating volume a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:29:06 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:06 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=68, name=volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f 1073741824" returned: 0 in 0.436s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f" returned: 0 in 0.143s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca115091-101f-4d18-a1ba-6aa690a18dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44b8b72-5a16-4fa7-8312-dc4d0946bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Volume volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f (a41e045f-1efc-46a0-bc0a-8630d5990c8f): created successfully
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44b8b72-5a16-4fa7-8312-dc4d0946bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Flow 'volume_create_manager' (30dd969d-1c87-4ca6-b311-da5130b66793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3e22df7d-953b-499f-9e11-15bd026ff77c tempest-SnapshotMetadataTestJSON-294390354 None] Created volume successfully.
Sep 10 17:29:08 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Creating offline snapshot c500fe12-0bc7-4193-94c8-7c9c73bd8138 of volume a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:29:08 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9083eada-d779-4832-9b07-3bc31018fa6f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f" returned: 0 in 0.517s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:09 devstack quobyte-client[82918]: System call of process 92290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:09 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=69, name=volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 1G" returned: 0 in 0.389s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "qemu-img rebase -u -b volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 0.185s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 0.107s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 0.109s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.info" returned: 0 in 0.144s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.info" returned: 0 in 0.202s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1241d0ca-db05-43da-b2f5-2e36dadd8a26 tempest-SnapshotMetadataTestJSON-294390354 None] Create snapshot completed successfully
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "cinder-c500fe12-0bc7-4193-94c8-7c9c73bd8138-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-c500fe12-0bc7-4193-94c8-7c9c73bd8138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "cinder-quobyte-c500fe12-0bc7-4193-94c8-7c9c73bd8138" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-c500fe12-0bc7-4193-94c8-7c9c73bd8138" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Deleting offline snapshot c500fe12-0bc7-4193-94c8-7c9c73bd8138 of volume a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] snapshot_file for this snap is: volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c48f8ab-d86f-4bc7-9429-69790507c71d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:14 devstack quobyte-client[82918]: System call of process 92300 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:14 devstack quobyte-client[82918]: System call of process 92300 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 1.123s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476996e-63d4-485a-ada1-906b9912ac1f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:16 devstack quobyte-client[82918]: System call of process 92307 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f" returned: 0 in 0.848s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:16 devstack quobyte-client[82918]: System call of process 92313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 0.722s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Acquiring lock "cinder-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f.c500fe12-0bc7-4193-94c8-7c9c73bd8138" returned: 0 in 0.432s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-c500fe12-0bc7-4193-94c8-7c9c73bd8138" released by "_delete_snapshot" :: held 4.069s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "cinder-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" released by "delete_snapshot" :: held 4.272s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Acquiring lock "cinder-quobyte-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "cinder-quobyte-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" acquired by "delete_volume" :: waited 0.174s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Created reservations ['2a5fcfde-0860-46b6-8894-16180f6142e3', '7c1550de-438d-44b0-9bae-e0e064498fcf', '32465764-a8fc-4dfc-bea2-4b9a24a61b6d', '60c8cb91-3abf-408b-8597-0a25816c9d3d'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[61919043-3981-4767-b042-dba60e0fd040]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "cinder-a41e045f-1efc-46a0-bc0a-8630d5990c8f-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Delete snapshot completed successfully.
Sep 10 17:29:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-a41e045f-1efc-46a0-bc0a-8630d5990c8f-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5706f8cc-3272-4faa-850a-331f0d1bee52 tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-c500fe12-0bc7-4193-94c8-7c9c73bd8138-delete_snapshot" released by "delete_snapshot" :: held 5.947s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" returned: 0 in 0.971s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" returned: 0 in 0.668s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "cinder-quobyte-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04" released by "delete_volume" :: held 1.958s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" acquired by "delete_volume" :: waited 0.096s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b84dfa-f7d8-448a-a732-a584bd385b35]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f" returned: 0 in 0.693s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:21 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Created reservations ['bd8b0088-1cc1-4463-a940-98bfd1c412fe', 'd8dac44a-7ec8-4124-9e14-bbeee421eeea', '4c441fc0-e71c-4862-9f81-f91b85910a46', '8287999f-6690-43af-9d61-c8d682e9c8cf'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a41e045f-1efc-46a0-bc0a-8630d5990c8f" returned: 0 in 0.458s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-quobyte-a41e045f-1efc-46a0-bc0a-8630d5990c8f" released by "delete_volume" :: held 1.397s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Created reservations ['0bfc04d8-2e2c-4681-91a5-2aa1594088f3', 'd493984f-0b0b-420d-ae4c-7a30345bfae7', 'a35c83bc-dcf1-43a3-9816-daab1f761706', '7254e8a1-fb69-4b73-b445-6ed31442950a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.430s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:29:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Deleted volume successfully.
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-550667d0-a706-4ef8-bb53-572e2c5d9715 tempest-VolumesNegativeTest-288631521 None] Lock "cinder-0de7fe6a-1b5c-4e7c-bddf-e87091b6bb04-delete_volume" released by "delete_volume" :: held 5.035s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.310s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:23 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:29:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Deleted volume successfully.
Sep 10 17:29:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-45cfd968-380f-4ea9-b4c2-b618ea09c09a tempest-SnapshotMetadataTestJSON-294390354 None] Lock "cinder-a41e045f-1efc-46a0-bc0a-8630d5990c8f-delete_volume" released by "delete_volume" :: held 4.273s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Flow 'volume_create_manager' (d03d5909-c234-4409-b925-22d838529bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fb5d4-bac0-4ac0-8727-2a9a4de535a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fb5d4-bac0-4ac0-8727-2a9a4de535a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1925928506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffc2ed6-afaa-40e5-84c8-473e71828a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a47105e93e44faf838230427c333dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:27Z,use_quota=True,user_id='169c3d77127f4cbb8a09aec7379b2f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67565a67-2409-4e1a-8cb0-403a67b6ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67565a67-2409-4e1a-8cb0-403a67b6ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8626c6fb-0e29-4c6e-ba70-96882372410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8626c6fb-0e29-4c6e-ba70-96882372410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffc2ed6-afaa-40e5-84c8-473e71828a07', 'volume_name': 'volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd0b919-d86e-44d6-a60e-c51fd2ac0808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd0b919-d86e-44d6-a60e-c51fd2ac0808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675471fd-0a13-4398-b601-de52665898c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:27 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07', 'volume_size': 1}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1925928506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffc2ed6-afaa-40e5-84c8-473e71828a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a47105e93e44faf838230427c333dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:27Z,use_quota=True,user_id='169c3d77127f4cbb8a09aec7379b2f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Creating volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:29:27 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:29:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:28 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=71, name=volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 1073741824" returned: 0 in 0.548s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07" returned: 0 in 0.179s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] <== create_volume: return (814ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:29:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675471fd-0a13-4398-b601-de52665898c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000a23e-da1f-4238-98b0-b236a6042bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 (4ffc2ed6-afaa-40e5-84c8-473e71828a07): created successfully
Sep 10 17:29:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000a23e-da1f-4238-98b0-b236a6042bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Flow 'volume_create_manager' (d03d5909-c234-4409-b925-22d838529bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-dd924fb8-5405-4098-97fa-1b0a27da0ec6 tempest-VolumesSnapshotListTestJSON-397755190 None] Created volume successfully.
Sep 10 17:29:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Flow 'volume_create_manager' (4e6f9eca-0a06-4171-854f-4ab7416e9d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29d6165-87f1-43d2-a03c-c8b5ef3b3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29d6165-87f1-43d2-a03c-c8b5ef3b3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1452042133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254ed518-0a4a-4527-877c-f07bde076ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840bcc622c5f4f04af24ea44656c32bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:30Z,use_quota=True,user_id='25aba3806c9a4149ab5154f0b670d8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62dd11b-e576-496a-bf46-621fc84714dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62dd11b-e576-496a-bf46-621fc84714dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46907b25-2fd0-484b-8b07-4bcded4608da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46907b25-2fd0-484b-8b07-4bcded4608da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254ed518-0a4a-4527-877c-f07bde076ff3', 'volume_name': 'volume-254ed518-0a4a-4527-877c-f07bde076ff3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cba98-dd64-4e0e-9c26-4d531469fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cba98-dd64-4e0e-9c26-4d531469fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb5252e-0b7d-412f-8df0-19c8f7cafe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:31 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Volume 254ed518-0a4a-4527-877c-f07bde076ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254ed518-0a4a-4527-877c-f07bde076ff3', 'volume_size': 1}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1452042133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254ed518-0a4a-4527-877c-f07bde076ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='840bcc622c5f4f04af24ea44656c32bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:29:30Z,use_quota=True,user_id='25aba3806c9a4149ab5154f0b670d8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Creating volume 254ed518-0a4a-4527-877c-f07bde076ff3 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:29:31 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:31 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=72, name=volume-254ed518-0a4a-4527-877c-f07bde076ff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:31 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3 1073741824" returned: 0 in 0.871s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3" returned: 0 in 0.166s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Creating offline snapshot 60446cbd-0366-42c0-9190-69961914f407 of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb5252e-0b7d-412f-8df0-19c8f7cafe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254ed518-0a4a-4527-877c-f07bde076ff3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07188fea-420b-4e04-9d6f-12ca4c513ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9636d-93d3-47ac-86e1-69f7f036d034]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:33 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Volume volume-254ed518-0a4a-4527-877c-f07bde076ff3 (254ed518-0a4a-4527-877c-f07bde076ff3): created successfully
Sep 10 17:29:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07188fea-420b-4e04-9d6f-12ca4c513ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:29:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Flow 'volume_create_manager' (4e6f9eca-0a06-4171-854f-4ab7416e9d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:29:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-dd236725-2d5f-41bf-8c78-7c762df59dca tempest-AbsoluteLimitsTests-1469560094 None] Created volume successfully.
Sep 10 17:29:34 devstack quobyte-client[82918]: System call of process 92419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07" returned: 0 in 1.262s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:34 devstack quobyte-client[82918]: System call of process 92426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:34 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=73, name=volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 1G" returned: 0 in 0.372s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:34 devstack quobyte-client[82918]: System call of process 92432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.353s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.209s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.180s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Acquiring lock "cinder-254ed518-0a4a-4527-877c-f07bde076ff3-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.info" returned: 0 in 0.320s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "cinder-254ed518-0a4a-4527-877c-f07bde076ff3-delete_volume" acquired by "delete_volume" :: waited 0.229s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.info" returned: 0 in 0.302s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Acquiring lock "cinder-quobyte-254ed518-0a4a-4527-877c-f07bde076ff3" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:36 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-26bfb9e2-efc1-435b-a51d-d9eba8f7a934 tempest-VolumesSnapshotListTestJSON-397755190 None] Create snapshot completed successfully
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "cinder-quobyte-254ed518-0a4a-4527-877c-f07bde076ff3" acquired by "delete_volume" :: waited 0.041s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ff98e-bdb5-4a9f-98c6-f9d2b9ee5403]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3" returned: 0 in 0.582s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254ed518-0a4a-4527-877c-f07bde076ff3" returned: 0 in 0.170s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "cinder-quobyte-254ed518-0a4a-4527-877c-f07bde076ff3" released by "delete_volume" :: held 0.942s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Creating offline snapshot 05228566-2bc5-434f-84ed-5ce7af9e4284 of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:29:37 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Created reservations ['7554ecb9-9bc9-4280-aa5d-844e42fbe778', '42ad672a-acc2-4374-b50d-d375ef0f944a', 'd5ef250c-bb4d-43e0-8f62-478f3d4a97fa', '1518c095-32d5-4ac5-972d-bae921036ce4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d497d-b82c-4580-81f4-beeab7b4100b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:38 devstack quobyte-client[82918]: System call of process 92449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.791s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.257s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:29:39 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Deleted volume successfully.
Sep 10 17:29:39 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=75, name=volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-37795307-678b-470b-a8a9-15ea70b202ef tempest-AbsoluteLimitsTests-1469560094 None] Lock "cinder-254ed518-0a4a-4527-877c-f07bde076ff3-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 1G" returned: 0 in 0.617s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.342s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.167s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.178s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3bb7946f-7b32-4b17-9f6b-0d3e607268ac tempest-VolumesSnapshotListTestJSON-397755190 None] Create snapshot completed successfully
Sep 10 17:29:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:29:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:29:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Creating offline snapshot 631f168d-d2e9-471b-99b2-231df742adee of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:29:43 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[549546f8-3642-445f-9bbc-0537a1248751]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 1.224s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:44 devstack quobyte-client[82918]: System call of process 92500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:45 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=76, name=volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee 1G" returned: 0 in 0.613s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:45 devstack quobyte-client[82918]: System call of process 92505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img rebase -u -b volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.339s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.191s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:29:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.164s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:29:46 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-532f0149-b0d5-4aa6-aa72-c7fc5534905c tempest-VolumesSnapshotListTestJSON-397755190 None] Create snapshot completed successfully
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-631f168d-d2e9-471b-99b2-231df742adee-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-631f168d-d2e9-471b-99b2-231df742adee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.149s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-631f168d-d2e9-471b-99b2-231df742adee" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-631f168d-d2e9-471b-99b2-231df742adee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Deleting offline snapshot 631f168d-d2e9-471b-99b2-231df742adee of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] snapshot_file for this snap is: volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ded349-b0f9-46d5-b455-0bfb06d9c206]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.742s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:50 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a57d03-dc5b-4e37-abe4-2699978acc9f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.585s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:51 devstack quobyte-client[82918]: System call of process 92516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.379s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.631f168d-d2e9-471b-99b2-231df742adee" returned: 0 in 0.173s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-631f168d-d2e9-471b-99b2-231df742adee" released by "_delete_snapshot" :: held 2.298s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" released by "delete_snapshot" :: held 2.492s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=51,cinder:SELECT=44,cinder:INSERT=28,cinder:DELETE=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=38,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Created reservations ['72b1fb88-3075-448b-a853-5c85c082013f', '95bac8da-cee0-460f-ba40-1669810a654c', 'b3494e41-2add-45a3-8078-77349eb457a7', '6f23abcc-c440-4823-b600-db103e725d36'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Delete snapshot completed successfully.
Sep 10 17:29:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-56432756-2de9-48c2-be3a-abfb050aa097 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-631f168d-d2e9-471b-99b2-231df742adee-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-05228566-2bc5-434f-84ed-5ce7af9e4284-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-05228566-2bc5-434f-84ed-5ce7af9e4284-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-05228566-2bc5-434f-84ed-5ce7af9e4284" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-05228566-2bc5-434f-84ed-5ce7af9e4284" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Deleting offline snapshot 05228566-2bc5-434f-84ed-5ce7af9e4284 of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] snapshot_file for this snap is: volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0edb6f-eafb-4a1d-9874-277ed2881666]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.867s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:54 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c5390-20cf-43ae-bd1c-0584872b777d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:55 devstack quobyte-client[82918]: System call of process 92523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.778s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.380s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.05228566-2bc5-434f-84ed-5ce7af9e4284" returned: 0 in 0.124s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-05228566-2bc5-434f-84ed-5ce7af9e4284" released by "_delete_snapshot" :: held 2.662s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" released by "delete_snapshot" :: held 2.707s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:56 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Created reservations ['4cfc799d-36b9-45dc-bff8-97ce4edff833', '73d0ccc6-2f99-4cf6-b272-ce214db6fa28', 'ab738258-e44c-4bc9-b18a-2d05c80cb579', 'd5fc7c95-cb15-43b3-9d2b-4c1cffd0a4b6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:29:57 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Delete snapshot completed successfully.
Sep 10 17:29:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-93bb4e2b-2ce1-459b-9610-8a9bd5e873a4 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-05228566-2bc5-434f-84ed-5ce7af9e4284-delete_snapshot" released by "delete_snapshot" :: held 3.660s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:29:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-60446cbd-0366-42c0-9190-69961914f407-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-60446cbd-0366-42c0-9190-69961914f407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:57 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:29:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-60446cbd-0366-42c0-9190-69961914f407" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-60446cbd-0366-42c0-9190-69961914f407" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Deleting offline snapshot 60446cbd-0366-42c0-9190-69961914f407 of volume 4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] snapshot_file for this snap is: volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[879782bf-8fc0-40d2-be2e-696bd1b2a0e1]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:29:59 devstack quobyte-client[82918]: System call of process 92531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:29:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 1.015s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:29:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:29:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e0fb7-6846-4e44-9be9-ab43621ed212]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:29:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07" returned: 0 in 1.341s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:00 devstack quobyte-client[82918]: System call of process 92538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.370s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07.60446cbd-0366-42c0-9190-69961914f407" returned: 0 in 0.174s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-60446cbd-0366-42c0-9190-69961914f407" released by "_delete_snapshot" :: held 4.052s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" released by "delete_snapshot" :: held 4.203s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.908s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:30:02 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Created reservations ['5e51ee44-87f1-4ef1-8e14-f2d0b4cdf237', '55c752b5-81dc-4047-a894-96ac93a62fc4', '530b1f97-25ad-4832-9272-d1a2843446dc', '3ac57bd9-f720-4631-b9f1-56c1dcd4c131'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:30:03 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Delete snapshot completed successfully.
Sep 10 17:30:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-baab9243-13d2-4c06-ae70-4199368ae100 tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-60446cbd-0366-42c0-9190-69961914f407-delete_snapshot" released by "delete_snapshot" :: held 5.183s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-4ffc2ed6-afaa-40e5-84c8-473e71828a07-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:30:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-4ffc2ed6-afaa-40e5-84c8-473e71828a07-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:30:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:30:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" acquired by "delete_volume" :: waited 0.037s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:30:04 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab5e4a-a10f-455f-9788-d289c8cdbc40]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:30:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07" returned: 0 in 0.900s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4ffc2ed6-afaa-40e5-84c8-473e71828a07" returned: 0 in 0.144s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-quobyte-4ffc2ed6-afaa-40e5-84c8-473e71828a07" released by "delete_volume" :: held 1.380s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:05 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Created reservations ['fbb257c2-7c87-4661-b9a3-ca66c2c2af35', '0a03a49e-082c-489b-8836-06a9cd121c32', 'd07c92ad-6c09-4696-9e80-caaebd2ce4a4', 'bfa0e144-876f-4609-a2c5-ebd6945524b4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.263s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:06 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:30:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Deleted volume successfully.
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a0b7a243-21ae-41e5-8d3c-181b2b35cebb tempest-VolumesSnapshotListTestJSON-397755190 None] Lock "cinder-4ffc2ed6-afaa-40e5-84c8-473e71828a07-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Flow 'volume_create_manager' (946efb64-1b1c-4fb0-8c4b-272a05baaf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bd5914-90e3-451a-96d8-a8a55d707354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bd5914-90e3-451a-96d8-a8a55d707354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1883229529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dbc1c5-6d48-4e86-850c-ee617111ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ccca7780974c62861c34af82122956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:06Z,use_quota=True,user_id='98231fcc5953498c8347da8a53b0625c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71775534-ead3-40e3-b54c-c249f94ef1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71775534-ead3-40e3-b54c-c249f94ef1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709dd4bd-37c7-459d-bc19-ae4601d91543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709dd4bd-37c7-459d-bc19-ae4601d91543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dbc1c5-6d48-4e86-850c-ee617111ccd5', 'volume_name': 'volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0d92c-a111-4ab9-b2b9-c6b584774679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e0d92c-a111-4ab9-b2b9-c6b584774679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34502cd5-94aa-4fb8-b908-41c2f45babed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5', 'volume_size': 1}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1883229529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dbc1c5-6d48-4e86-850c-ee617111ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ccca7780974c62861c34af82122956',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:06Z,use_quota=True,user_id='98231fcc5953498c8347da8a53b0625c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Creating volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:30:07 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=77, name=volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 1073741824" returned: 0 in 0.526s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.173s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34502cd5-94aa-4fb8-b908-41c2f45babed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707a8f7b-8e4a-4224-b33c-78cceac240ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:08 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Volume volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 (a0dbc1c5-6d48-4e86-850c-ee617111ccd5): created successfully
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707a8f7b-8e4a-4224-b33c-78cceac240ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Flow 'volume_create_manager' (946efb64-1b1c-4fb0-8c4b-272a05baaf74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:30:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-308d6564-e018-4ee1-a025-ef5883771cff tempest-VolumesActionsTest-379769630 None] Created volume successfully.
Sep 10 17:30:18 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=22,cinder:INSERT=12,cinder:UPDATE=26 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:30:18 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:30:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:30:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:30:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:50 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:30:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (a90df6c8-6a4b-48d6-9b0e-4c883a5b1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:30:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456e927d-5c6f-4a17-a152-75d8449390b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456e927d-5c6f-4a17-a152-75d8449390b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776779770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d54e17-bb4b-4766-8c96-78d6f83cf016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:50Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706d1859-313c-469c-8f65-ca45e8e6c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706d1859-313c-469c-8f65-ca45e8e6c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c32e9c7-85b4-47ec-8d8b-f9f3ad8a9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c32e9c7-85b4-47ec-8d8b-f9f3ad8a9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d54e17-bb4b-4766-8c96-78d6f83cf016', 'volume_name': 'volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8a9540-c163-4385-90da-2ca63de92aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8a9540-c163-4385-90da-2ca63de92aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f9c430-9ef8-4af7-bb11-4dff35383b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Volume d3d54e17-bb4b-4766-8c96-78d6f83cf016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016', 'volume_size': 1}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776779770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d54e17-bb4b-4766-8c96-78d6f83cf016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:30:50Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Creating volume d3d54e17-bb4b-4766-8c96-78d6f83cf016 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:30:51 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:30:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:51 devstack quobyte-client[82918]: System call of process 92753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:30:51 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=78, name=volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:30:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 1073741824" returned: 0 in 1.151s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:30:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016" returned: 0 in 0.387s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:30:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] <== create_volume: return (1721ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:30:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:30:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" by "attach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:30:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f9c430-9ef8-4af7-bb11-4dff35383b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8163e212-f44e-4382-b1b8-c376c24921e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:30:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" acquired by "attach_volume" :: waited 0.317s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:30:54 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Volume volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 (d3d54e17-bb4b-4766-8c96-78d6f83cf016): created successfully
Sep 10 17:30:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8163e212-f44e-4382-b1b8-c376c24921e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:30:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (a90df6c8-6a4b-48d6-9b0e-4c883a5b1972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:30:54 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Attaching volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5 to instance 03e135d3-a5c6-4b73-b795-ab3483c948fd at mountpoint /dev/vdb on host None.
Sep 10 17:30:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c219dbb3-f4a0-41ae-a9e9-895d79f152e1 tempest-AttachVolumeTestJSON-704514118 None] Created volume successfully.
Sep 10 17:30:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Attach volume completed successfully.
Sep 10 17:30:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-322e597c-92ce-4532-8323-c681cb50cd81 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" released by "attach_volume" :: held 1.010s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" by "detach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:30:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:30:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:55 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Detaching volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5 from instance 03e135d3-a5c6-4b73-b795-ab3483c948fd.
Sep 10 17:30:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:30:55 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Detach volume completed successfully.
Sep 10 17:30:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-52c5de68-165e-40b3-bc39-e6eca7ca02b9 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:30:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:30:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:30:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d476bb5a-66a3-48ac-a91e-484fe53d650b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:30:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016" returned: 0 in 0.606s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.712s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37911609-c5f2-44fa-b407-9251ea47d91d', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:31:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (96fef96f-e717-4929-9dd1-52edaef48c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20cc4d3-4691-4234-8701-5bd48df73e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20cc4d3-4691-4234-8701-5bd48df73e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1619503393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90819e32-dda1-41c7-b22e-74ecb00257a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:01Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c91172c-f031-4dae-800d-2ad4f75176c1),volume_type_id=3c91172c-f031-4dae-800d-2ad4f75176c1)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1ae871-1c2e-4b71-a9a2-02458ea00294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1ae871-1c2e-4b71-a9a2-02458ea00294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38bc4f-c1cc-42b3-9d52-b2241cec4eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38bc4f-c1cc-42b3-9d52-b2241cec4eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90819e32-dda1-41c7-b22e-74ecb00257a9', 'volume_name': 'volume-90819e32-dda1-41c7-b22e-74ecb00257a9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce416afa-3e76-4d02-a017-42a516931f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce416afa-3e76-4d02-a017-42a516931f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b73ffa-6394-441b-bcb8-f361b4587cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:01 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume 90819e32-dda1-41c7-b22e-74ecb00257a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90819e32-dda1-41c7-b22e-74ecb00257a9', 'volume_size': 1}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1619503393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90819e32-dda1-41c7-b22e-74ecb00257a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:01Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c91172c-f031-4dae-800d-2ad4f75176c1),volume_type_id=3c91172c-f031-4dae-800d-2ad4f75176c1)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Creating volume 90819e32-dda1-41c7-b22e-74ecb00257a9 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:31:01 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:31:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:01 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=79, name=volume-90819e32-dda1-41c7-b22e-74ecb00257a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-b9ab8ca5-dbf1-4d82-8d05-c27969afdd6a req-d0b64c03-abfe-4a9a-8a83-d213ffd33ba3 tempest-AttachVolumeTestJSON-704514118 None] attachment_update completed successfully.
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 1073741824" returned: 0 in 1.189s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.858s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:03 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (294ec48b-a8cb-4577-8cad-887501d42ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82236d44-27dc-4bb8-bb28-ae63228dfb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82236d44-27dc-4bb8-bb28-ae63228dfb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2124265009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780b867-14e8-4918-9fb5-d883ed325d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:02Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e9113f4-5805-4ab6-80fd-b6ad3845534f),volume_type_id=9e9113f4-5805-4ab6-80fd-b6ad3845534f)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1a946-49a3-402c-b7ae-6359ce4f004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1a946-49a3-402c-b7ae-6359ce4f004a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dd0b4d-2e72-4e7c-8cc0-8b093e17c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49dd0b4d-2e72-4e7c-8cc0-8b093e17c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1780b867-14e8-4918-9fb5-d883ed325d9b', 'volume_name': 'volume-1780b867-14e8-4918-9fb5-d883ed325d9b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd14ef74-c280-40e6-acce-953f6e7f58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd14ef74-c280-40e6-acce-953f6e7f58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9478c86-853b-4d61-9d36-6fa082535370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:03 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume 1780b867-14e8-4918-9fb5-d883ed325d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1780b867-14e8-4918-9fb5-d883ed325d9b', 'volume_size': 1}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9" returned: 0 in 1.166s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] <== create_volume: return (2376ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.385s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2124265009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1780b867-14e8-4918-9fb5-d883ed325d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:02Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e9113f4-5805-4ab6-80fd-b6ad3845534f),volume_type_id=9e9113f4-5805-4ab6-80fd-b6ad3845534f)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Creating volume 1780b867-14e8-4918-9fb5-d883ed325d9b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:31:03 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:31:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:31:04 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=80, name=volume-1780b867-14e8-4918-9fb5-d883ed325d9b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (1af0cb3b-c684-44fb-b8e5-790d9b793a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83d593e-b29c-40fa-8833-210fadfa1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b73ffa-6394-441b-bcb8-f361b4587cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90819e32-dda1-41c7-b22e-74ecb00257a9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f55734-ca95-42f2-9bfa-4d9ae495c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83d593e-b29c-40fa-8833-210fadfa1d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1575959157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc9e523-e4f4-4dcc-8ade-9df3d86f2858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:03Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c3ebde9-9a57-4a7d-9eea-75f20bbd305a),volume_type_id=6c3ebde9-9a57-4a7d-9eea-75f20bbd305a)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c8d3e7-ad82-41f1-b808-e77092c24d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c8d3e7-ad82-41f1-b808-e77092c24d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd1211a-2394-4315-8d04-9443b903fd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b 1073741824" returned: 0 in 0.879s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:04 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume volume-90819e32-dda1-41c7-b22e-74ecb00257a9 (90819e32-dda1-41c7-b22e-74ecb00257a9): created successfully
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f55734-ca95-42f2-9bfa-4d9ae495c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (96fef96f-e717-4929-9dd1-52edaef48c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b" returned: 0 in 0.438s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] <== create_volume: return (1350ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b786a819-1806-41fb-8c0b-68297d9e8a97 tempest-TestInstancesWithCinderVolumes-428655578 None] Created volume successfully.
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9478c86-853b-4d61-9d36-6fa082535370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1780b867-14e8-4918-9fb5-d883ed325d9b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdead6cf-82fc-4abf-a207-856871b12170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:05 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume volume-1780b867-14e8-4918-9fb5-d883ed325d9b (1780b867-14e8-4918-9fb5-d883ed325d9b): created successfully
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdead6cf-82fc-4abf-a207-856871b12170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (294ec48b-a8cb-4577-8cad-887501d42ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd1211a-2394-4315-8d04-9443b903fd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cc9e523-e4f4-4dcc-8ade-9df3d86f2858', 'volume_name': 'volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858', 'volume_size': 1, 'image_id': '065eaae7-2459-4a90-b981-b96379082bdb', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--100086135', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2707a84ba11643239c9e431c98237389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '065eaae7-2459-4a90-b981-b96379082bdb', 'created_at': datetime.datetime(2025, 9, 10, 15, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/065eaae7-2459-4a90-b981-b96379082bdb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038df1ceb0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32591834-3cc3-48f4-8626-625b6d85268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32591834-3cc3-48f4-8626-625b6d85268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c3f756-de5a-438b-96d3-1cf8ddbdd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:05 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858', 'volume_size': 1, 'image_id': '065eaae7-2459-4a90-b981-b96379082bdb', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--100086135', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2707a84ba11643239c9e431c98237389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '065eaae7-2459-4a90-b981-b96379082bdb', 'created_at': datetime.datetime(2025, 9, 10, 15, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/065eaae7-2459-4a90-b981-b96379082bdb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038df1ceb0>}
Sep 10 17:31:05 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Cloning 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 from image 065eaae7-2459-4a90-b981-b96379082bdb  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:31:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6c7557ae-c7f7-4ea2-864c-fe734bcf1303 tempest-TestInstancesWithCinderVolumes-428655578 None] Created volume successfully.
Sep 10 17:31:07 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD, size 20.69 MB, duration 2.06 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:31:07 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Image download 20.69 MB at 10.06 MB/s
Sep 10 17:31:07 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[559d1a3d-e16c-41c1-918c-1d6f5edb07ec]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:08 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD
Sep 10 17:31:08 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:31:10 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Sep 10 17:31:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD" returned: 0 in 2.496s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:10 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Temporary image 065eaae7-2459-4a90-b981-b96379082bdb is fetched for user ac62bbbf7e3f4c8cae56ea4cdfa71b47. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:31:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5063dbe-d0ae-4766-800e-f3b7850062de]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:11 devstack sudo[93215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD
Sep 10 17:31:11 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:31:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (31aed11c-95e3-4b7d-9d1a-c0df11fc5122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197d543-988e-4c7f-9507-f369dc8fb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197d543-988e-4c7f-9507-f369dc8fb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1923040290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c17dfd9-2811-43ab-bcf2-121112ce46c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:11Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb2ed2e-1988-41c3-aaf2-227662c81d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb2ed2e-1988-41c3-aaf2-227662c81d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287615f5-3656-4aeb-af85-6d8cf9e1e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287615f5-3656-4aeb-af85-6d8cf9e1e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c17dfd9-2811-43ab-bcf2-121112ce46c7', 'volume_name': 'volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1a643d-e0c3-4526-a35a-0b8f476d731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1a643d-e0c3-4526-a35a-0b8f476d731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69de6a66-d76a-4f46-8c28-f26b36f32e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:11 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Volume 9c17dfd9-2811-43ab-bcf2-121112ce46c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7', 'volume_size': 1}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1923040290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c17dfd9-2811-43ab-bcf2-121112ce46c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f7a4b708f04133b336c5c4875fa7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:11Z,use_quota=True,user_id='73771c71d10c4eca96d898d2fd231d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Creating volume 9c17dfd9-2811-43ab-bcf2-121112ce46c7 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:31:11 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:31:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:12 devstack quobyte-client[82918]: System call of process 93217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:31:12 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=81, name=volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 1073741824" returned: 0 in 0.456s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7" returned: 0 in 0.171s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69de6a66-d76a-4f46-8c28-f26b36f32e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe75245-12be-4528-aa08-58e868cfc628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:12 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Volume volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 (9c17dfd9-2811-43ab-bcf2-121112ce46c7): created successfully
Sep 10 17:31:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe75245-12be-4528-aa08-58e868cfc628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Flow 'volume_create_manager' (31aed11c-95e3-4b7d-9d1a-c0df11fc5122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4981be2e-e3b8-498a-b4e4-e02a148253ca tempest-AttachVolumeTestJSON-704514118 None] Created volume successfully.
Sep 10 17:31:13 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD" returned: 0 in 3.134s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1575959157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc9e523-e4f4-4dcc-8ade-9df3d86f2858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2707a84ba11643239c9e431c98237389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:31:03Z,use_quota=True,user_id='ac62bbbf7e3f4c8cae56ea4cdfa71b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c3ebde9-9a57-4a7d-9eea-75f20bbd305a),volume_type_id=6c3ebde9-9a57-4a7d-9eea-75f20bbd305a)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Creating volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:31:13 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:31:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:13 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=82, name=volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 1073741824" returned: 0 in 0.397s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.608s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Attempting download of 065eaae7-2459-4a90-b981-b96379082bdb ((None, None)) to volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd8772f-f23f-45d9-93fd-f16b1511c269]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_065eaae7-2459-4a90-b981-b96379082bdb_pnk4ll32 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_065eaae7-2459-4a90-b981-b96379082bdb_pnk4ll32" returned: 0 in 0.593s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_065eaae7-2459-4a90-b981-b96379082bdb_pnk4ll32 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_065eaae7-2459-4a90-b981-b96379082bdb_pnk4ll32" returned: 1 in 0.521s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_065eaae7-2459-4a90-b981-b96379082bdb_pnk4ll32' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13677ce-3c6f-4ec9-9134-b0ba30b1bb71]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD" returned: 0 in 0.596s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] 065eaae7-2459-4a90-b981-b96379082bdb was qcow2, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:31:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:17 devstack quobyte-client[82918]: System call of process 93239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:31:17 devstack quobyte-client[82918]: System call of process 93239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:31:17 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=82, name=volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:31:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 1.835s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:18 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_065eaae7-2459-4a90-b981-b96379082bdb_xmhuecg1devstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:31:18 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Converted 112.00 MB image at 57.44 MB/s
Sep 10 17:31:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 1G" returned: 0 in 0.247s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:19 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f030528e-e26b-48db-a004-c382077efdca]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:20 devstack quobyte-client[82918]: System call of process 93266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.026s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb33e18d-74e5-4473-924b-59f5fb803ada]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 1.466s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7" returned: 0 in 0.740s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 1 in 0.757s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Downloaded image 065eaae7-2459-4a90-b981-b96379082bdb ((None, None)) to volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Temporary image 065eaae7-2459-4a90-b981-b96379082bdb for user ac62bbbf7e3f4c8cae56ea4cdfa71b47 is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Marking volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Copying metadata from image 065eaae7-2459-4a90-b981-b96379082bdb to 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:31:21 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Creating volume glance metadata for volume 7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 backed by image 065eaae7-2459-4a90-b981-b96379082bdb with: {'image_id': '065eaae7-2459-4a90-b981-b96379082bdb', 'image_name': 'tempest-scenario-img--100086135', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:31:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5da1af7-dc27-4433-92f4-415379eb34b7', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:31:22 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c3f756-de5a-438b-96d3-1cf8ddbdd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858', 'volume_size': 1, 'image_id': '065eaae7-2459-4a90-b981-b96379082bdb', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--100086135', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2707a84ba11643239c9e431c98237389', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '065eaae7-2459-4a90-b981-b96379082bdb', 'created_at': datetime.datetime(2025, 9, 10, 15, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/065eaae7-2459-4a90-b981-b96379082bdb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038df1ceb0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9614ca2d-07a3-497e-860c-d9b89b49d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:31:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-2625ba77-373f-4a26-b7c1-06aac5eb1ec1 req-603bfe3e-fb53-471a-a974-e953dba1545b tempest-AttachVolumeTestJSON-704514118 None] attachment_update completed successfully.
Sep 10 17:31:22 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Volume volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 (7cc9e523-e4f4-4dcc-8ade-9df3d86f2858): created successfully
Sep 10 17:31:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9614ca2d-07a3-497e-860c-d9b89b49d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:31:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Flow 'volume_create_manager' (1af0cb3b-c684-44fb-b8e5-790d9b793a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:31:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9b936407-8e54-42c5-83a6-e23aafd5359f tempest-TestInstancesWithCinderVolumes-428655578 None] Created volume successfully.
Sep 10 17:31:32 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=29,cinder:UPDATE=16,cinder:INSERT=11,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:31:32 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=19,cinder:SELECT=27,cinder:DELETE=3 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:31:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.023s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ec2ec-735d-4cd5-8a0a-0db7e8cc347e]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 1.196s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 1 in 0.632s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:31:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.173s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:31:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23976bbe-5e6f-4a10-91f7-683157a47448', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:31:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-d699cc6a-526f-4857-85e1-e5523cbc154a req-40e0170d-658c-46aa-9395-6f3cc5c00d19 tempest-TestInstancesWithCinderVolumes-428655578 None] attachment_update completed successfully.
Sep 10 17:31:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" by "attach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:31:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" acquired by "attach_volume" :: waited 0.061s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:31:41 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Attaching volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5 to instance 31b34515-ae24-4675-902b-aae8bce535f8 at mountpoint /dev/vdb on host None.
Sep 10 17:31:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Attach volume completed successfully.
Sep 10 17:31:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-580b9f1a-7968-4bea-91fe-e99be9abb48b tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" released by "attach_volume" :: held 0.247s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:31:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" by "detach_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:31:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:31:41 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Detaching volume a0dbc1c5-6d48-4e86-850c-ee617111ccd5 from instance 31b34515-ae24-4675-902b-aae8bce535f8.
Sep 10 17:31:41 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:42 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Detach volume completed successfully.
Sep 10 17:31:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-46dbe0f9-1094-4f1b-be04-1f4dff536c24 tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-detach_volume" released by "detach_volume" :: held 0.205s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:31:52 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:31:52 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:31:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7adad6d4-1d6e-4d6e-9e21-1d18f6a72ad6 req-c2d9f77a-5fdb-4d80-82d5-f0749b957513 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7adad6d4-1d6e-4d6e-9e21-1d18f6a72ad6 req-c2d9f77a-5fdb-4d80-82d5-f0749b957513 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-7adad6d4-1d6e-4d6e-9e21-1d18f6a72ad6 req-c2d9f77a-5fdb-4d80-82d5-f0749b957513 tempest-AttachVolumeTestJSON-704514118 None] Terminate volume connection completed successfully.
Sep 10 17:31:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-7adad6d4-1d6e-4d6e-9e21-1d18f6a72ad6 req-c2d9f77a-5fdb-4d80-82d5-f0749b957513 tempest-AttachVolumeTestJSON-704514118 None] Deleting attachment 37911609-c5f2-44fa-b407-9251ea47d91d. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:31:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:31:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:31:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:31:56 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[881faf93-21f9-4cba-83ee-f23654be0e4c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 1.001s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:57 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf01e65-eff1-41a1-85fe-8667dba396e5]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:31:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:31:58 devstack quobyte-client[82918]: System call of process 93594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:31:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.709s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:31:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.e29806b7-e910-4882-8e8e-c016846a0c04tl6zk194.img {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:32:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:03 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:32:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 1.244s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:32:06 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:32:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.e29806b7-e910-4882-8e8e-c016846a0c04tl6zk194.img" returned: 0 in 10.174s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:08 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e15dff-5b70-4b55-a96b-1a9d5050bd35]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:32:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:09 devstack quobyte-client[82918]: System call of process 93618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:32:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.998s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:09 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.e29806b7-e910-4882-8e8e-c016846a0c04tl6zk194.img {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:32:09 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Converted 1024.00 MB image at 100.59 MB/s
Sep 10 17:32:09 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] e29806b7-e910-4882-8e8e-c016846a0c04 was raw, no need to convert to raw {{(pid=82884) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 10 17:32:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-fe7d6f51-6693-41c6-8c3e-0ee3941854d4 req-4ed57ae8-47a1-4ed7-bd83-9736c9a0d967 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:32:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-fe7d6f51-6693-41c6-8c3e-0ee3941854d4 req-4ed57ae8-47a1-4ed7-bd83-9736c9a0d967 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:32:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-fe7d6f51-6693-41c6-8c3e-0ee3941854d4 req-4ed57ae8-47a1-4ed7-bd83-9736c9a0d967 tempest-AttachVolumeTestJSON-704514118 None] Terminate volume connection completed successfully.
Sep 10 17:32:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-fe7d6f51-6693-41c6-8c3e-0ee3941854d4 req-4ed57ae8-47a1-4ed7-bd83-9736c9a0d967 tempest-AttachVolumeTestJSON-704514118 None] Deleting attachment a5da1af7-dc27-4433-92f4-415379eb34b7. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:32:19 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:32:28 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:32:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-9c17dfd9-2811-43ab-bcf2-121112ce46c7-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-9c17dfd9-2811-43ab-bcf2-121112ce46c7-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:41 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:32:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-quobyte-9c17dfd9-2811-43ab-bcf2-121112ce46c7" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-9c17dfd9-2811-43ab-bcf2-121112ce46c7" acquired by "delete_volume" :: waited 0.073s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:41 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccee605-2331-479e-8163-aff67c6adcef]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:32:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7" returned: 0 in 1.024s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9c17dfd9-2811-43ab-bcf2-121112ce46c7" returned: 0 in 0.192s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-9c17dfd9-2811-43ab-bcf2-121112ce46c7" released by "delete_volume" :: held 1.413s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:32:43 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Created reservations ['69153b95-a592-4821-9561-48ecd3c32c8d', '8126a1ca-2693-41da-b557-817299004a45', '39530b3f-702d-45b1-95dc-a0e2e23bcbd1', '817b23c6-74e4-4363-8b79-a2ea4a096357'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.168s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:32:44 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Deleted volume successfully.
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-d3d54e17-bb4b-4766-8c96-78d6f83cf016-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-9e5ec881-cd01-4743-aabd-82022e0ab842 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-9c17dfd9-2811-43ab-bcf2-121112ce46c7-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:32:44 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-d3d54e17-bb4b-4766-8c96-78d6f83cf016-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-quobyte-d3d54e17-bb4b-4766-8c96-78d6f83cf016" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-d3d54e17-bb4b-4766-8c96-78d6f83cf016" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[52497d7c-3abd-49fe-b04d-c5e9360fa62e]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016" returned: 0 in 0.723s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d3d54e17-bb4b-4766-8c96-78d6f83cf016" returned: 0 in 0.157s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-d3d54e17-bb4b-4766-8c96-78d6f83cf016" released by "delete_volume" :: held 1.098s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Created reservations ['a89433c0-f725-4892-a4a0-c04de8369105', '8139328a-28c0-4319-9f27-27b1194a962d', '43df9d10-07b1-4acb-9810-0afae9956d08', '8c8c8658-7ed8-4597-8468-eb6e899b70ff'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:32:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.174s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-cfb42825-5a0c-4817-9b84-6666676305d0-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Deleted volume successfully.
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-cfb42825-5a0c-4817-9b84-6666676305d0-delete_volume" acquired by "delete_volume" :: waited 0.242s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-111d670e-e8df-42bc-9cc8-e023288b5cf9 tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-d3d54e17-bb4b-4766-8c96-78d6f83cf016-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:32:47 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "cinder-quobyte-cfb42825-5a0c-4817-9b84-6666676305d0" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-cfb42825-5a0c-4817-9b84-6666676305d0" acquired by "delete_volume" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[65481b7d-cb48-4ae3-9fc6-3d1b7a7b3758]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:32:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0" returned: 0 in 0.977s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cfb42825-5a0c-4817-9b84-6666676305d0" returned: 0 in 0.311s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-quobyte-cfb42825-5a0c-4817-9b84-6666676305d0" released by "delete_volume" :: held 1.789s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Created reservations ['beac101f-90e0-42bc-a60a-09e914fa335a', '3ba5fa1b-47b1-4c61-bfa5-251fc543dcf0', '85f4ef70-dd47-4f9b-bd40-f4d29cdb3757', '44a3c4cf-f3d2-4e5a-8305-ed409d5caeb6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:32:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:32:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.196s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:32:51 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:32:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Deleted volume successfully.
Sep 10 17:32:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d42a96ac-c4a2-4150-aa95-961b591caefc tempest-AttachVolumeTestJSON-704514118 None] Lock "cinder-cfb42825-5a0c-4817-9b84-6666676305d0-delete_volume" released by "delete_volume" :: held 3.965s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:33:00 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=16,cinder:UPDATE=19,cinder:INSERT=10,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:01 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=15,cinder:UPDATE=30,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.336s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:33:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:33:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 80.066s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Uploaded volume to glance image-id: e29806b7-e910-4882-8e8e-c016846a0c04. {{(pid=82884) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 17:33:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.799s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:33:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2808ad4-2902-4a92-9532-3d524c132f62]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:16 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-62c4571a-5614-4a65-aff2-04828a201b3c tempest-VolumesActionsTest-379769630 None] Copy volume to image completed successfully.
Sep 10 17:33:17 devstack quobyte-client[82918]: System call of process 93794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:33:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9" returned: 0 in 0.907s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-90819e32-dda1-41c7-b22e-74ecb00257a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a19b420a-d5f5-4be9-aa76-23278264afa5', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:33:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:33:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-fdc4f9dd-a835-40f5-bfec-f6504f9d68d5 req-6a59bd80-333d-4dfe-ad88-9946ee0d647a tempest-TestInstancesWithCinderVolumes-428655578 None] attachment_update completed successfully.
Sep 10 17:33:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:33:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:33:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:33:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d707bb26-3af7-404a-a5fb-9822ce902c0b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:20 devstack quobyte-client[82918]: System call of process 93799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:33:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 1.285s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4483ac4c-2476-4433-9211-333221799edf]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.585s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:21 devstack quobyte-client[82918]: System call of process 93811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:33:28 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:28 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img" returned: 0 in 9.859s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c027e6-ccfe-483d-9747-57309dfddb00]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.846s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:31 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5, size 1024.00 MB, duration 9.87 sec, destination /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:33:31 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Converted 1024.00 MB image at 103.78 MB/s
Sep 10 17:33:31 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] 7b801d1a-f226-41f1-bbcc-836d3c1090c6 was raw, converting to qcow2 {{(pid=82884) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 10 17:33:32 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2aa711-3144-4ad6-b145-1261af087eb1]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img" returned: 0 in 0.651s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img" returned: 1 in 0.722s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img /opt/stack/data/cinder/conversion/vol_upload_mdfjq0_v {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img /opt/stack/data/cinder/conversion/vol_upload_mdfjq0_v" returned: 0 in 0.250s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0dbc1c5-6d48-4e86-850c-ee617111ccd5.temp_image.7b801d1a-f226-41f1-bbcc-836d3c1090c6r9ca986m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mdfjq0_v {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:33:33 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[89220751-3482-4bdc-8ac2-3e952f5aab56]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mdfjq0_v {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mdfjq0_v" returned: 0 in 0.451s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.363s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Uploaded volume to glance image-id: 7b801d1a-f226-41f1-bbcc-836d3c1090c6. {{(pid=82884) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 17:33:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:33:36 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6137f6-8336-4f0d-96fc-4d1d04109fac]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:36 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-01fe0d7e-8bb3-40ee-9cc8-7de9f6184538 tempest-VolumesActionsTest-379769630 None] Copy volume to image completed successfully.
Sep 10 17:33:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b" returned: 0 in 0.616s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-1780b867-14e8-4918-9fb5-d883ed325d9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adfa6084-0e05-4207-8a6d-55e77d4a3969', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:33:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:33:37 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-c01f03c6-9253-4618-aff0-51541f7719c5 req-b42707c7-937d-41dc-aa25-a300ca092e23 tempest-TestInstancesWithCinderVolumes-428655578 None] attachment_update completed successfully.
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:33:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Acquiring lock "cinder-quobyte-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "cinder-quobyte-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9138f3c-4603-48d9-b21a-c7869754cd7f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.568s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" returned: 0 in 0.134s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "cinder-quobyte-a0dbc1c5-6d48-4e86-850c-ee617111ccd5" released by "delete_volume" :: held 0.896s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Created reservations ['09551231-b333-451a-ba6f-aadbab7ed639', '5796f41c-bd14-498e-a9ec-74350293a064', 'bfe25fdc-8dbc-4ad5-94cb-211bb9b09f8b', '8c82d5b1-67fc-44f2-b2fc-18d98a3a99d7'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:33:39 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:33:39 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Deleted volume successfully.
Sep 10 17:33:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f76cbcb3-b5c4-4ca2-86df-bd74153f97cf tempest-VolumesActionsTest-379769630 None] Lock "cinder-a0dbc1c5-6d48-4e86-850c-ee617111ccd5-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:33:49 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:49 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:33:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:33:55 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Flow 'volume_create_manager' (2261354a-823d-48eb-8d73-9b6666d765d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74b982e-5911-4ee4-99f0-fc77892cd3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74b982e-5911-4ee4-99f0-fc77892cd3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744197962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9e2a09-fe19-41a9-b1c7-62597c30e203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ec2997818e4036a0d261da309db196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:33:55Z,use_quota=True,user_id='d96db1585e1c46a78b322a4f8802779b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17674761-f559-468d-a11e-071d659a0af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17674761-f559-468d-a11e-071d659a0af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:33:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b16552-cd87-44c4-a1dc-1d4d8f4cc132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:33:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b16552-cd87-44c4-a1dc-1d4d8f4cc132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b9e2a09-fe19-41a9-b1c7-62597c30e203', 'volume_name': 'volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dd46c50>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:33:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b152bd-52ce-4850-ab39-fdc37b6ce96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:33:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b152bd-52ce-4850-ab39-fdc37b6ce96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:33:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc510a0d-6f80-485a-82a7-109c0c1d0f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:33:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dd46c50>}
Sep 10 17:33:57 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Cloning 0b9e2a09-fe19-41a9-b1c7-62597c30e203 from image 3a863299-f273-4a78-81cf-9aa7d2a025e9  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:33:58 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:33:58 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 17:33:58 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d68299e-3072-4026-af7a-078e38d8487d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:33:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:33:59 devstack sudo[94053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD
Sep 10 17:33:59 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:34:01 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root
Sep 10 17:34:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD" returned: 0 in 3.252s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:01 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 is fetched for user d96db1585e1c46a78b322a4f8802779b. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.235s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55e9322-2942-4e4f-8cc0-11fd0a637ba4]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:02 devstack sudo[94072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD
Sep 10 17:34:02 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:34:04 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root
Sep 10 17:34:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD" returned: 0 in 2.474s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1744197962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9e2a09-fe19-41a9-b1c7-62597c30e203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ec2997818e4036a0d261da309db196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:33:55Z,use_quota=True,user_id='d96db1585e1c46a78b322a4f8802779b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Creating volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:34:05 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:05 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=83, name=volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 1073741824" returned: 0 in 0.416s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 0.100s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] <== create_volume: return (604ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:05 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Attempting download of 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:34:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[155b49bd-101b-4151-9572-82273b24ae6f]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_pgxr6hn2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_pgxr6hn2" returned: 0 in 0.639s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_pgxr6hn2 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_pgxr6hn2" returned: 1 in 0.688s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_pgxr6hn2' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:34:07 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75eb86f-26d2-4afe-b8c8-07ee6cf21ece]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD" returned: 0 in 1.076s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:08 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] 3a863299-f273-4a78-81cf-9aa7d2a025e9 was qcow2, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:34:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:09 devstack quobyte-client[82918]: System call of process 94096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:09 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=83, name=volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 1.565s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:10 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_g0fqca3xdevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:34:10 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Converted 112.00 MB image at 68.94 MB/s
Sep 10 17:34:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:10 devstack quobyte-client[82918]: System call of process 94102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 1G" returned: 0 in 0.269s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc3135-b817-4664-9080-64d7a48d63e9]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 0.497s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 1 in 0.618s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Downloaded image 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 for user d96db1585e1c46a78b322a4f8802779b is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Marking volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Copying metadata from image 3a863299-f273-4a78-81cf-9aa7d2a025e9 to 0b9e2a09-fe19-41a9-b1c7-62597c30e203. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Creating volume glance metadata for volume 0b9e2a09-fe19-41a9-b1c7-62597c30e203 backed by image 3a863299-f273-4a78-81cf-9aa7d2a025e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc510a0d-6f80-485a-82a7-109c0c1d0f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dd46c50>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a719894-8c1f-4315-bd3d-598d2fd9f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:12 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Volume volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 (0b9e2a09-fe19-41a9-b1c7-62597c30e203): created successfully
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a719894-8c1f-4315-bd3d-598d2fd9f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Flow 'volume_create_manager' (2261354a-823d-48eb-8d73-9b6666d765d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:34:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fd44aa58-c117-4395-800d-23e3a80a0452 tempest-VolumesExtendTest-2087849046 None] Created volume successfully.
Sep 10 17:34:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c64395-958e-42ca-a76f-c7abd9fb800f]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 0.435s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 1 in 0.432s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 2G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 2G" returned: 0 in 0.244s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.306s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5287c7b5-68da-4da4-8dc0-eaea6e5831d0 tempest-VolumesExtendTest-2087849046 None] Extend volume completed successfully.
Sep 10 17:34:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-450a1ad3-29b7-4a1d-9e22-21fb3d794762 req-87a10689-30a2-40de-b6b5-d6f92cc38beb tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-0b9e2a09-fe19-41a9-b1c7-62597c30e203-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-450a1ad3-29b7-4a1d-9e22-21fb3d794762 req-87a10689-30a2-40de-b6b5-d6f92cc38beb tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:16 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-450a1ad3-29b7-4a1d-9e22-21fb3d794762 req-87a10689-30a2-40de-b6b5-d6f92cc38beb tempest-TestInstancesWithCinderVolumes-428655578 None] Terminate volume connection completed successfully.
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-450a1ad3-29b7-4a1d-9e22-21fb3d794762 req-87a10689-30a2-40de-b6b5-d6f92cc38beb tempest-TestInstancesWithCinderVolumes-428655578 None] Deleting attachment a19b420a-d5f5-4be9-aa76-23278264afa5. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "cinder-0b9e2a09-fe19-41a9-b1c7-62597c30e203-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-quobyte-0b9e2a09-fe19-41a9-b1c7-62597c30e203" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-0b9e2a09-fe19-41a9-b1c7-62597c30e203" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e2c827-fae5-4776-b820-655697db030e]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:17 devstack quobyte-client[82918]: System call of process 94120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 0.527s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-90819e32-dda1-41c7-b22e-74ecb00257a9-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 1 in 0.888s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-90819e32-dda1-41c7-b22e-74ecb00257a9-delete_volume" acquired by "delete_volume" :: waited 0.301s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0b9e2a09-fe19-41a9-b1c7-62597c30e203" returned: 0 in 0.368s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-0b9e2a09-fe19-41a9-b1c7-62597c30e203" released by "delete_volume" :: held 2.077s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-quobyte-90819e32-dda1-41c7-b22e-74ecb00257a9" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-90819e32-dda1-41c7-b22e-74ecb00257a9" acquired by "delete_volume" :: waited 0.101s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Created reservations ['a22d4078-3d00-4628-8812-075faf6c847c', 'c85a1d66-80cc-4fb7-94e1-582484b3862f', 'cf182909-eb30-4f33-b1b1-dccd1ffb3007', '9f81b2e3-7c6b-4bf9-926c-55800da163ea'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[444b7582-a4cc-4a30-9fdf-f394d9971307]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:19 devstack quobyte-client[82918]: System call of process 94132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9" returned: 0 in 0.812s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.056s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-90819e32-dda1-41c7-b22e-74ecb00257a9" returned: 0 in 0.578s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-90819e32-dda1-41c7-b22e-74ecb00257a9" released by "delete_volume" :: held 1.700s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.544s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:20 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:34:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Deleted volume successfully.
Sep 10 17:34:21 devstack cinder-volume[82884]: WARNING cinder.quota [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960880317-291882228 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960880317-291882228, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:34:21 devstack cinder-volume[82884]: WARNING cinder.quota [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960880317-291882228 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960880317-291882228, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4f342ddb-d57a-4d9f-94a8-22315181908c tempest-VolumesExtendTest-2087849046 None] Lock "cinder-0b9e2a09-fe19-41a9-b1c7-62597c30e203-delete_volume" released by "delete_volume" :: held 5.015s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Created reservations ['bf13fb3b-5adb-4c2c-9b8a-7db79525db45', 'd3bb7623-f22a-4984-b082-1bc4f3502af7', 'e48b69f8-be17-457f-916f-2c2c4fa55f59', '8415ffb3-17ed-4b5e-9801-0cd4cac7e42f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Flow 'volume_create_manager' (72bcc49b-cebe-4ca5-9e17-06b7d40e44f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b036e8e-27b2-4963-8244-17956898192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b036e8e-27b2-4963-8244-17956898192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1011062914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f215367-6ccd-46bb-9a01-94b3321158b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ec2997818e4036a0d261da309db196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:21Z,use_quota=True,user_id='d96db1585e1c46a78b322a4f8802779b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d17d4-14b5-4a42-aa43-f6c92ce6cc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78d17d4-14b5-4a42-aa43-f6c92ce6cc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252f1c2e-8901-4395-9815-dff37bde7b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252f1c2e-8901-4395-9815-dff37bde7b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f215367-6ccd-46bb-9a01-94b3321158b8', 'volume_name': 'volume-8f215367-6ccd-46bb-9a01-94b3321158b8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3786fec3-3f39-4a33-b227-9767fda9e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3786fec3-3f39-4a33-b227-9767fda9e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5946ee48-abc4-46ae-9c59-b23519dac41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:21 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Volume 8f215367-6ccd-46bb-9a01-94b3321158b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f215367-6ccd-46bb-9a01-94b3321158b8', 'volume_size': 1}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1011062914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f215367-6ccd-46bb-9a01-94b3321158b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ec2997818e4036a0d261da309db196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:21Z,use_quota=True,user_id='d96db1585e1c46a78b322a4f8802779b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Creating volume 8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:34:21 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:21 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=84, name=volume-8f215367-6ccd-46bb-9a01-94b3321158b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.332s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:34:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Deleted volume successfully.
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 1073741824" returned: 0 in 0.860s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-323ec7fc-84dc-4247-99ba-943645103af2 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-90819e32-dda1-41c7-b22e-74ecb00257a9-delete_volume" released by "delete_volume" :: held 4.599s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 0.430s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] <== create_volume: return (1308ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:34:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5946ee48-abc4-46ae-9c59-b23519dac41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f215367-6ccd-46bb-9a01-94b3321158b8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ccdac7-29ce-4545-bac9-26ee53f4aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:23 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Volume volume-8f215367-6ccd-46bb-9a01-94b3321158b8 (8f215367-6ccd-46bb-9a01-94b3321158b8): created successfully
Sep 10 17:34:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ccdac7-29ce-4545-bac9-26ee53f4aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Flow 'volume_create_manager' (72bcc49b-cebe-4ca5-9e17-06b7d40e44f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:34:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9f63e54d-7d22-479c-b9d9-002044907695 tempest-VolumesExtendTest-2087849046 None] Created volume successfully.
Sep 10 17:34:24 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Creating offline snapshot 45112db4-fa1f-4c10-a971-8115e78f25bf of volume 8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:34:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243ea80-dcab-4b8f-b7b2-7e3f7a7f86fc]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:24 devstack quobyte-client[82918]: System call of process 94154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 0.801s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:25 devstack quobyte-client[82918]: System call of process 94159 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:25 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=85, name=volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf 1G" returned: 0 in 0.611s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8f215367-6ccd-46bb-9a01-94b3321158b8 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:26 devstack quobyte-client[82918]: System call of process 94168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img rebase -u -b volume-8f215367-6ccd-46bb-9a01-94b3321158b8 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.417s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.173s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.325s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.info" returned: 0 in 0.204s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.info" returned: 0 in 0.169s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.459s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:28 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-929422ef-fae9-4f21-9b95-a2c95ec00408 tempest-VolumesExtendTest-2087849046 None] Create snapshot completed successfully
Sep 10 17:34:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[447ed27d-6161-4694-b0c8-4d8cce99f2e2]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:29 devstack quobyte-client[82918]: System call of process 94186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 1.041s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf 2G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:30 devstack quobyte-client[82918]: System call of process 94190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf 2G" returned: 0 in 0.449s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.684s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-155c6ee7-9114-452c-a647-bc49e265790b tempest-VolumesExtendTest-2087849046 None] Extend volume completed successfully.
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-45112db4-fa1f-4c10-a971-8115e78f25bf-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-45112db4-fa1f-4c10-a971-8115e78f25bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:31 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-quobyte-45112db4-fa1f-4c10-a971-8115e78f25bf" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-45112db4-fa1f-4c10-a971-8115e78f25bf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Deleting offline snapshot 45112db4-fa1f-4c10-a971-8115e78f25bf of volume 8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] snapshot_file for this snap is: volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7aa156-f5d7-47be-8272-d3206609c2fa]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:32 devstack quobyte-client[82918]: System call of process 94193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.743s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f215367-6ccd-46bb-9a01-94b3321158b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:34:32 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8996a-80f6-4061-8a1e-f97c1f6c686b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:33 devstack quobyte-client[82918]: System call of process 94199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 0.556s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:33 devstack quobyte-client[82918]: System call of process 94203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.465s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8.45112db4-fa1f-4c10-a971-8115e78f25bf" returned: 0 in 0.120s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-45112db4-fa1f-4c10-a971-8115e78f25bf" released by "_delete_snapshot" :: held 2.348s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" released by "delete_snapshot" :: held 2.412s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:34 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Created reservations ['f6d2a98a-faf5-4554-ab5b-8d14e6c2a1b0', 'bbc807eb-4ec2-42c4-9de0-27d4320a369e', 'bc04a509-4d62-451a-beac-6de315a39629', '0840fdee-2a75-4afe-8bae-f71713717bfb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Delete snapshot completed successfully.
Sep 10 17:34:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a30e574b-65a7-46ff-a636-8e4791f747c6 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-45112db4-fa1f-4c10-a971-8115e78f25bf-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-8f215367-6ccd-46bb-9a01-94b3321158b8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-8f215367-6ccd-46bb-9a01-94b3321158b8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a2561-44c2-4694-a6d0-ec68478afdcf]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 0.535s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8f215367-6ccd-46bb-9a01-94b3321158b8" returned: 0 in 0.102s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-quobyte-8f215367-6ccd-46bb-9a01-94b3321158b8" released by "delete_volume" :: held 0.824s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Created reservations ['25937bbf-2633-40c7-a3a8-f1e1910a3c3d', 'e1398c1d-d581-4fe6-85ba-d77bffa9b6e0', 'cca41a31-74fb-413e-8ff0-4a968514a1c1', '21b1a4d4-7227-48f6-995f-42d33a05e2ed'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:36 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:34:37 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Deleted volume successfully.
Sep 10 17:34:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2b10fb80-ecb9-44b8-905e-02ec0704cdd4 tempest-VolumesExtendTest-2087849046 None] Lock "cinder-8f215367-6ccd-46bb-9a01-94b3321158b8-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:45 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Flow 'volume_create_manager' (d2a714c9-3d8a-49f9-bc87-ae5f35eed600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f01f5a-f3a7-4970-9252-4abbcd1e6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f01f5a-f3a7-4970-9252-4abbcd1e6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-508832545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce9208ac67c46eaba8b2c44d043ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:46Z,use_quota=True,user_id='77db75e03c12430eb34967a6c9195561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f1d97-89c6-46b2-abef-b171573880f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90f1d97-89c6-46b2-abef-b171573880f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c822f5b6-0a30-4286-baf0-cd03b5501bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c822f5b6-0a30-4286-baf0-cd03b5501bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0', 'volume_name': 'volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0', 'volume_size': 2}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0313df4-2158-4c51-a375-77a2303413ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0313df4-2158-4c51-a375-77a2303413ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e315aac8-6bd5-4fb0-9a21-53ca33cfe28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:46 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume 3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0', 'volume_size': 2}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-508832545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce9208ac67c46eaba8b2c44d043ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:34:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:34:46Z,use_quota=True,user_id='77db75e03c12430eb34967a6c9195561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Creating volume 3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:34:46 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 2147483648 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:46 devstack quobyte-client[82918]: System call of process 94246 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:34:46 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=87, name=volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 2147483648" returned: 0 in 0.651s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" returned: 0 in 0.118s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] <== create_volume: return (844ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:34:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e315aac8-6bd5-4fb0-9a21-53ca33cfe28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0', 'volume_size': 2}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06dc065-0204-4c1d-a492-e04685585ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:34:47 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 (3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0): created successfully
Sep 10 17:34:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06dc065-0204-4c1d-a492-e04685585ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:34:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Flow 'volume_create_manager' (d2a714c9-3d8a-49f9-bc87-ae5f35eed600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:34:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-88654db5-9383-4cfc-b285-d14c9ec7c543 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Created volume successfully.
Sep 10 17:34:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Creating offline snapshot c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e of volume 3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:34:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b0675-aea4-4914-aae4-d8d6fb8add19]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" returned: 0 in 0.480s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e 2G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:49 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=88, name=volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e 2G" returned: 0 in 0.265s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "qemu-img rebase -u -b volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.179s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.085s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.089s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.info" returned: 0 in 0.091s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.info" returned: 0 in 0.087s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.660s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=34,cinder:UPDATE=45,cinder:INSERT=14,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:34:50 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=41,cinder:UPDATE=44,cinder:INSERT=15,cinder:DELETE=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:34:50 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d90aebc2-028a-4169-862c-16e7ba68e6aa tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Create snapshot completed successfully
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "cinder-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:51 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "cinder-quobyte-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Deleting offline snapshot c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e of volume 3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] snapshot_file for this snap is: volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab809c-7292-48ef-8359-98322c544300]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.532s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:34:52 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c1d588-ca59-4ec2-905e-d913b4a123ae]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-ec378eca-48af-42ee-8b47-6c4a061963c5 req-7fb01876-24e9-4e67-a5b3-9dede31fe875 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" returned: 0 in 0.898s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-ec378eca-48af-42ee-8b47-6c4a061963c5 req-7fb01876-24e9-4e67-a5b3-9dede31fe875 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-ec378eca-48af-42ee-8b47-6c4a061963c5 req-7fb01876-24e9-4e67-a5b3-9dede31fe875 tempest-TestInstancesWithCinderVolumes-428655578 None] Terminate volume connection completed successfully.
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-ec378eca-48af-42ee-8b47-6c4a061963c5 req-7fb01876-24e9-4e67-a5b3-9dede31fe875 tempest-TestInstancesWithCinderVolumes-428655578 None] Deleting attachment adfa6084-0e05-4207-8a6d-55e77d4a3969. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.385s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0.c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e" released by "_delete_snapshot" :: held 2.312s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" released by "delete_snapshot" :: held 2.338s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Created reservations ['faad8122-d5a3-42d7-9aaa-03a2b03c0fc3', 'a7dcd492-9c61-4a9c-9b68-8822b4bc7536', '323acf18-4141-4914-a35d-fadfbd3ff57b', 'b0041728-69c2-497a-b6b4-5096eb8a1951'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Delete snapshot completed successfully.
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-1780b867-14e8-4918-9fb5-d883ed325d9b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bc3e7d9a-372d-4890-804c-a99d65547ca8 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-c559e8f5-c120-484c-a8aa-8ddd0e2d1b2e-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-1780b867-14e8-4918-9fb5-d883ed325d9b-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-quobyte-1780b867-14e8-4918-9fb5-d883ed325d9b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "cinder-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-1780b867-14e8-4918-9fb5-d883ed325d9b" acquired by "delete_volume" :: waited 0.101s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[42126bd1-5fed-4aa2-b2d1-af168ebf922d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b" returned: 0 in 0.866s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" acquired by "delete_volume" :: waited 0.214s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09539ee-5f23-4c76-a7fd-9848c5e55c65]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1780b867-14e8-4918-9fb5-d883ed325d9b" returned: 0 in 0.475s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-1780b867-14e8-4918-9fb5-d883ed325d9b" released by "delete_volume" :: held 1.626s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:57 devstack cinder-volume[82884]: WARNING cinder.quota [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272210216-478324526 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272210216-478324526, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:34:57 devstack cinder-volume[82884]: WARNING cinder.quota [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272210216-478324526 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1272210216-478324526, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:34:57 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Created reservations ['a07de2fd-926b-456c-ac3f-18fbc721e6aa', '6c0c3f4e-bebd-4fba-aeb1-27d96e05fe9b', 'a1bb531f-f81d-4212-a102-1532cdf7e82b', 'aa1c1cd7-8f99-4ca6-86db-5514f3a33e52'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" returned: 0 in 1.011s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" returned: 0 in 0.554s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-quobyte-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0" released by "delete_volume" :: held 1.890s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.493s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:34:58 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:34:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Deleted volume successfully.
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Created reservations ['425ca859-e3c0-4a47-a16e-af1660a9ea89', '11b2250b-9ac8-4904-a8ed-cf718a86b3b2', '68fbefba-d6a1-4b8e-83b6-3aa3097a48f3', 'b5972c50-77b4-4f54-832d-b72134a5484a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b156a55d-7ac3-4954-a521-785d84d9a515 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-1780b867-14e8-4918-9fb5-d883ed325d9b-delete_volume" released by "delete_volume" :: held 4.750s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:34:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.290s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:00 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:35:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Deleted volume successfully.
Sep 10 17:35:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b107852-2420-491f-af99-bead172e7ca6 tempest-VolumesSnapshotNegativeTestJSON-371246270 None] Lock "cinder-3858c51c-f8a9-4a6a-8b9d-e6cfa0f22da0-delete_volume" released by "delete_volume" :: held 5.677s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.190s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:35:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-f627f5e2-8a91-4b4a-a94b-ce1356ab0b41 req-6a347ffb-38c3-46c0-9c80-cbd6cb1c0c73 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:35:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-f627f5e2-8a91-4b4a-a94b-ce1356ab0b41 req-6a347ffb-38c3-46c0-9c80-cbd6cb1c0c73 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:35:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-f627f5e2-8a91-4b4a-a94b-ce1356ab0b41 req-6a347ffb-38c3-46c0-9c80-cbd6cb1c0c73 tempest-TestInstancesWithCinderVolumes-428655578 None] Terminate volume connection completed successfully.
Sep 10 17:35:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-f627f5e2-8a91-4b4a-a94b-ce1356ab0b41 req-6a347ffb-38c3-46c0-9c80-cbd6cb1c0c73 tempest-TestInstancesWithCinderVolumes-428655578 None] Deleting attachment 23976bbe-5e6f-4a10-91f7-683157a47448. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:35:09 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=33 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:35:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:35:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:35:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:35:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "cinder-quobyte-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:35:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" acquired by "delete_volume" :: waited 0.043s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:35:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d1cddd-5b83-491c-b517-b8622a728e7c]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:35:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 0.997s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:35:16 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:35:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (cb196399-bba2-467e-940f-2d8b64610c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:35:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ef8bc-99c4-4b5a-9aaf-af0124f09c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6ef8bc-99c4-4b5a-9aaf-af0124f09c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1555371738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:35:16Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92bc142-6248-46ea-8b28-a231340b911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92bc142-6248-46ea-8b28-a231340b911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680bcb6-f3d3-40d9-adaf-8fe69ef309de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680bcb6-f3d3-40d9-adaf-8fe69ef309de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34', 'volume_name': 'volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d041680a-6d51-499e-8869-c568bcaee5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d041680a-6d51-499e-8869-c568bcaee5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83958af0-5068-4c14-85f5-e2b92b11cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Volume b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34', 'volume_size': 1}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1555371738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:35:16Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Creating volume b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:35:17 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 1 in 1.308s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:17 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=90, name=volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:35:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" returned: 0 in 0.355s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-quobyte-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858" released by "delete_volume" :: held 3.174s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 1073741824" returned: 0 in 1.004s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" returned: 0 in 0.307s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] <== create_volume: return (1432ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:35:18 devstack cinder-volume[82884]: WARNING cinder.quota [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1221403279-662393432 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1221403279-662393432, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:35:18 devstack cinder-volume[82884]: WARNING cinder.quota [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1221403279-662393432 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1221403279-662393432, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83958af0-5068-4c14-85f5-e2b92b11cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde2844a-3e79-492e-aced-4624e9013c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:35:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Volume volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 (b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34): created successfully
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde2844a-3e79-492e-aced-4624e9013c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (cb196399-bba2-467e-940f-2d8b64610c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:35:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8d13a99d-e3a8-4618-ac1e-da4b1d84b888 tempest-AttachVolumeNegativeTest-1477211521 None] Created volume successfully.
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Created reservations ['b9625bf6-c3bf-4099-a46f-1192ee5c277b', '1ad1c1c5-40b3-456c-8bd3-648cf2d5c2ef', '65cf2781-41df-443b-82fa-e93902e73ec4', '05aa2eb5-b0f3-492c-b8f5-ccb337759563'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:35:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.318s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:20 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:35:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Deleted volume successfully.
Sep 10 17:35:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-81a7a9d3-cee4-4b16-ac7d-da5a1e873423 tempest-TestInstancesWithCinderVolumes-428655578 None] Lock "cinder-7cc9e523-e4f4-4dcc-8ade-9df3d86f2858-delete_volume" released by "delete_volume" :: held 6.048s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:35:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:35:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:35:25 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bbba2-98c8-4826-a5a0-cf630d97a925]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:35:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:35:26 devstack quobyte-client[82918]: System call of process 94415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:35:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" returned: 0 in 1.125s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:35:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.298s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:35:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99db1650-2e62-40bf-8be3-b6770f903bb5', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:35:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:35:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-40c50179-cce3-427c-9a53-5f938b2f0c0b req-8c90d401-0590-48b6-a503-a22de390b424 tempest-AttachVolumeNegativeTest-1477211521 None] attachment_update completed successfully.
Sep 10 17:35:37 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:35:37 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=30,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.164s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:36:02 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:36:44 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:37:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:37:01 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:37:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Flow 'volume_create_manager' (cdf1b5c8-9ca5-4511-ae24-6f400c362e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:37:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3a1d9a-fc0e-4991-a6ef-81062d859212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3a1d9a-fc0e-4991-a6ef-81062d859212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-611443719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254b3037-c148-4d24-9310-3621362710fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdccd52e41ad4de0add5adc0e444c36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:01Z,use_quota=True,user_id='ff3b0d3be5bf408291d2c48517efceb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d187cde1-eb0d-4b33-8ca6-0360e3ada7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d187cde1-eb0d-4b33-8ca6-0360e3ada7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417a0ac-6d42-45dc-b8f5-9fbe4cee4d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a417a0ac-6d42-45dc-b8f5-9fbe4cee4d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254b3037-c148-4d24-9310-3621362710fe', 'volume_name': 'volume-254b3037-c148-4d24-9310-3621362710fe', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f052eadc-125f-46b4-8a22-5e49c34b9104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f052eadc-125f-46b4-8a22-5e49c34b9104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747362e6-1e87-4f70-8c1e-f51a48a59ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Volume 254b3037-c148-4d24-9310-3621362710fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254b3037-c148-4d24-9310-3621362710fe', 'volume_size': 1}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-611443719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254b3037-c148-4d24-9310-3621362710fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdccd52e41ad4de0add5adc0e444c36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:37:01Z,use_quota=True,user_id='ff3b0d3be5bf408291d2c48517efceb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Creating volume 254b3037-c148-4d24-9310-3621362710fe {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:37:02 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:37:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:37:02 devstack quobyte-client[82918]: System call of process 95211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:37:03 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=91, name=volume-254b3037-c148-4d24-9310-3621362710fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.072s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.299s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:37:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:37:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.968s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:37:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:37:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe 1073741824" returned: 0 in 2.464s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:37:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:37:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe" returned: 0 in 0.343s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:37:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] <== create_volume: return (3016ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:37:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.075s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:37:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747362e6-1e87-4f70-8c1e-f51a48a59ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254b3037-c148-4d24-9310-3621362710fe', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bd8e68-bee3-495a-83b5-a86c6b39c969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:37:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Volume volume-254b3037-c148-4d24-9310-3621362710fe (254b3037-c148-4d24-9310-3621362710fe): created successfully
Sep 10 17:37:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bd8e68-bee3-495a-83b5-a86c6b39c969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:37:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Flow 'volume_create_manager' (cdf1b5c8-9ca5-4511-ae24-6f400c362e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:37:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4c59d48e-b750-47c0-b307-b84acb40ba6a tempest-TestMinimumBasicScenario-831063047 None] Created volume successfully.
Sep 10 17:37:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:37:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:37:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34cb213-c531-4a84-ab9d-4fe22e6be4d7]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:37:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:37:12 devstack quobyte-client[82918]: System call of process 95237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:37:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe" returned: 0 in 0.740s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:37:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:37:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-254b3037-c148-4d24-9310-3621362710fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8dbf788-bdab-456a-a724-8bff7bef7684', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:37:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:37:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-27caae37-f1a4-463c-9462-04d7f52ada4b req-cf047cde-bd5d-483b-b5da-ce44d78dbd27 tempest-TestMinimumBasicScenario-831063047 None] attachment_update completed successfully.
Sep 10 17:37:23 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:37:23 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.194s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:38:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:38:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-bb19086b-0a8f-4003-8fa2-55f867d7d087 req-969942a9-f134-41f8-8f03-c853c41ff418 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:38:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-bb19086b-0a8f-4003-8fa2-55f867d7d087 req-969942a9-f134-41f8-8f03-c853c41ff418 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:38:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-bb19086b-0a8f-4003-8fa2-55f867d7d087 req-969942a9-f134-41f8-8f03-c853c41ff418 tempest-AttachVolumeNegativeTest-1477211521 None] Terminate volume connection completed successfully.
Sep 10 17:38:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-bb19086b-0a8f-4003-8fa2-55f867d7d087 req-969942a9-f134-41f8-8f03-c853c41ff418 tempest-AttachVolumeNegativeTest-1477211521 None] Deleting attachment 99db1650-2e62-40bf-8be3-b6770f903bb5. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:38:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:38:44 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:38:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Flow 'volume_create_manager' (71d528fc-5098-4fc7-8dab-075bd4e3b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537bd454-c82c-4038-a269-f819bb71150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537bd454-c82c-4038-a269-f819bb71150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-763255141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba53bdb4-0188-40db-a73e-d33dcf3ec86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62898d445b7d455799cca77e54711c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:52Z,use_quota=True,user_id='e5efdc9e0c90482aacae39ff686bb2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e583a1-3919-4e99-b78a-e858a53e9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e583a1-3919-4e99-b78a-e858a53e9af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1194824-8ec0-444f-beaa-04ce39ec9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1194824-8ec0-444f-beaa-04ce39ec9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba53bdb4-0188-40db-a73e-d33dcf3ec86a', 'volume_name': 'volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d91dd9-0831-451c-a620-ca62803a65a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d91dd9-0831-451c-a620-ca62803a65a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1983a887-6976-49e4-ab73-13259edef8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume ba53bdb4-0188-40db-a73e-d33dcf3ec86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a', 'volume_size': 1}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-763255141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba53bdb4-0188-40db-a73e-d33dcf3ec86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62898d445b7d455799cca77e54711c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:38:52Z,use_quota=True,user_id='e5efdc9e0c90482aacae39ff686bb2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Creating volume ba53bdb4-0188-40db-a73e-d33dcf3ec86a {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:38:52 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:38:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:38:53 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=92, name=volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:38:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a 1073741824" returned: 0 in 0.789s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:38:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" returned: 0 in 0.359s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] <== create_volume: return (1326ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1983a887-6976-49e4-ab73-13259edef8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1608685-ca10-42a3-9c17-df025a2e802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:38:54 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a (ba53bdb4-0188-40db-a73e-d33dcf3ec86a): created successfully
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1608685-ca10-42a3-9c17-df025a2e802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:38:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Flow 'volume_create_manager' (71d528fc-5098-4fc7-8dab-075bd4e3b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:38:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c6bb128a-b456-4ac5-be9f-e674bdfdc3b5 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Created volume successfully.
Sep 10 17:39:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:39:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:39:00 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f16f9-a683-4003-a803-6920eb57e349]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:39:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:39:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" returned: 0 in 0.662s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:39:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.764s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:39:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22cb05d2-b40e-4de9-81e7-5d482ec2b414', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:39:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:39:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-ba1c5c87-31d0-4519-9b4a-323f80300904 req-8d49a01c-57c3-4d9a-a55b-6e26c6c970b1 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] attachment_update completed successfully.
Sep 10 17:39:02 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:39:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.242s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:39:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:39:12 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:DELETE=1,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:39:12 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:39:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-c13bf38b-835f-4b90-932e-37fe89886c26 req-b3d56427-7518-4a70-80c4-55d085e17f67 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:39:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-c13bf38b-835f-4b90-932e-37fe89886c26 req-b3d56427-7518-4a70-80c4-55d085e17f67 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:39:36 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-c13bf38b-835f-4b90-932e-37fe89886c26 req-b3d56427-7518-4a70-80c4-55d085e17f67 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Terminate volume connection completed successfully.
Sep 10 17:39:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-c13bf38b-835f-4b90-932e-37fe89886c26 req-b3d56427-7518-4a70-80c4-55d085e17f67 tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Deleting attachment 22cb05d2-b40e-4de9-81e7-5d482ec2b414. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "cinder-ba53bdb4-0188-40db-a73e-d33dcf3ec86a-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "cinder-ba53bdb4-0188-40db-a73e-d33dcf3ec86a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:39:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "cinder-quobyte-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "cinder-quobyte-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59c2fa-30a8-46a0-b976-01dfc5c41156]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:39:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:39:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" returned: 0 in 0.576s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:39:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:39:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" returned: 0 in 0.170s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:39:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "cinder-quobyte-ba53bdb4-0188-40db-a73e-d33dcf3ec86a" released by "delete_volume" :: held 1.060s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Created reservations ['47fd76d3-6f70-4342-98bc-aad37f9abf2b', '36a574f3-00a5-4fc0-bf32-dea8fd48a17e', 'fd95bfaf-be16-4bf3-a80a-533e6bad84cb', 'a8983a77-f3db-46f4-9eea-5f5e6c3c7215'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.236s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:39:41 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:39:42 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Deleted volume successfully.
Sep 10 17:39:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5c568806-b28d-4822-bd77-fb0bc22dba8b tempest-TestServerVolumeAttachScenarioOldVersion-1871537109 None] Lock "cinder-ba53bdb4-0188-40db-a73e-d33dcf3ec86a-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:39:51 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:39:52 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.126s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-3be9275a-8518-425d-a287-ca46bfdf3e8e req-2aa4f321-e46a-4735-aad4-ea557cf9c28b tempest-TestMinimumBasicScenario-831063047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-3be9275a-8518-425d-a287-ca46bfdf3e8e req-2aa4f321-e46a-4735-aad4-ea557cf9c28b tempest-TestMinimumBasicScenario-831063047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-3be9275a-8518-425d-a287-ca46bfdf3e8e req-2aa4f321-e46a-4735-aad4-ea557cf9c28b tempest-TestMinimumBasicScenario-831063047 None] Terminate volume connection completed successfully.
Sep 10 17:40:15 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-3be9275a-8518-425d-a287-ca46bfdf3e8e req-2aa4f321-e46a-4735-aad4-ea557cf9c28b tempest-TestMinimumBasicScenario-831063047 None] Deleting attachment b8dbf788-bdab-456a-a724-8bff7bef7684. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:40:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (d3fd7ece-c334-4e27-a79d-8724e4c638fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faebdde-63ad-4efa-9400-5eef24e3eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faebdde-63ad-4efa-9400-5eef24e3eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104245914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3656ba13-3334-4e3d-9d0a-125684b21b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:16Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a29d65-3ed7-4551-a82e-7a475717c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a29d65-3ed7-4551-a82e-7a475717c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87569f81-5f8f-45f5-8ca4-6a81323d3e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87569f81-5f8f-45f5-8ca4-6a81323d3e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3656ba13-3334-4e3d-9d0a-125684b21b81', 'volume_name': 'volume-3656ba13-3334-4e3d-9d0a-125684b21b81', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a7214-216e-444a-bad1-464ec38fe355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (445a7214-216e-444a-bad1-464ec38fe355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3592939-6668-4fe1-8ca1-b55c100fb5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:16 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Volume 3656ba13-3334-4e3d-9d0a-125684b21b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3656ba13-3334-4e3d-9d0a-125684b21b81', 'volume_size': 1}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2104245914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3656ba13-3334-4e3d-9d0a-125684b21b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:16Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Creating volume 3656ba13-3334-4e3d-9d0a-125684b21b81 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:16 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:16 devstack quobyte-client[82918]: System call of process 96176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:16 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=93, name=volume-3656ba13-3334-4e3d-9d0a-125684b21b81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81 1073741824" returned: 0 in 0.587s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (a8b90c83-9f41-42c9-b10f-f4654a7348ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde125dc-40b0-4029-ae7d-4fd8b1197870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (7fd7c8be-ea1d-44b0-85bb-8f49abe8ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77c4c93-0cf1-4320-a622-4cac3438c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81" returned: 0 in 0.520s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] <== create_volume: return (1141ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde125dc-40b0-4029-ae7d-4fd8b1197870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205455472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42736e-b689-4785-a430-a331e213f822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:16Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a53d537-2e66-4083-88fa-ffe76bad9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a53d537-2e66-4083-88fa-ffe76bad9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7298cb26-cd34-4b6e-9b83-753de01e835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7298cb26-cd34-4b6e-9b83-753de01e835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb42736e-b689-4785-a430-a331e213f822', 'volume_name': 'volume-cb42736e-b689-4785-a430-a331e213f822', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef02a160-1b26-4dc1-810e-136782e22fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef02a160-1b26-4dc1-810e-136782e22fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c760bcd-934a-40af-91be-09aa6d03d6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Volume cb42736e-b689-4785-a430-a331e213f822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb42736e-b689-4785-a430-a331e213f822', 'volume_size': 1}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205455472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42736e-b689-4785-a430-a331e213f822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:16Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Creating volume cb42736e-b689-4785-a430-a331e213f822 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:17 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:17 devstack quobyte-client[82918]: System call of process 96181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:17 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=94, name=volume-cb42736e-b689-4785-a430-a331e213f822, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77c4c93-0cf1-4320-a622-4cac3438c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497129921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc693d6-6eba-4875-9611-17df25dd0932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:17Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5dd96d-cd20-4bb6-86d5-ba1c13b1a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5dd96d-cd20-4bb6-86d5-ba1c13b1a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b810111-1d05-4724-b69e-961e02b3adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b810111-1d05-4724-b69e-961e02b3adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc693d6-6eba-4875-9611-17df25dd0932', 'volume_name': 'volume-ebc693d6-6eba-4875-9611-17df25dd0932', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8dee5b-1457-45d0-b525-3b8e60ad9a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8dee5b-1457-45d0-b525-3b8e60ad9a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ccb009-329c-4ce2-a5ed-d25cbd3c2beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Volume ebc693d6-6eba-4875-9611-17df25dd0932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc693d6-6eba-4875-9611-17df25dd0932', 'volume_size': 1}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3592939-6668-4fe1-8ca1-b55c100fb5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3656ba13-3334-4e3d-9d0a-125684b21b81', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3acaa93-b169-42f1-9d6e-0d94618c74e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "cinder-254b3037-c148-4d24-9310-3621362710fe-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822 1073741824" returned: 0 in 1.042s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Volume volume-3656ba13-3334-4e3d-9d0a-125684b21b81 (3656ba13-3334-4e3d-9d0a-125684b21b81): created successfully
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3acaa93-b169-42f1-9d6e-0d94618c74e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (d3fd7ece-c334-4e27-a79d-8724e4c638fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "cinder-254b3037-c148-4d24-9310-3621362710fe-delete_volume" acquired by "delete_volume" :: waited 0.461s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (7d7f71b3-eb2f-4a3c-9638-00917c473468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dd49c-2d6a-407e-a503-f1e403d6bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822" returned: 0 in 0.527s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] <== create_volume: return (1628ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e18d5157-2513-4d34-b558-90acf4ef16e2 tempest-CreateVolumesFromImageTest-2063413908 None] Created volume successfully.
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-497129921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc693d6-6eba-4875-9611-17df25dd0932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:17Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Creating volume ebc693d6-6eba-4875-9611-17df25dd0932 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:19 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (f0186b73-eb21-472e-b914-c2b4b6e24b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=95, name=volume-ebc693d6-6eba-4875-9611-17df25dd0932, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888c626-2e49-4539-9fd3-eca57a871086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2dd49c-2d6a-407e-a503-f1e403d6bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575840827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf953d-35ee-4e4f-86cf-19ba30795b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:18Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb646bc-c266-4739-9094-793f50ae186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb646bc-c266-4739-9094-793f50ae186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a3510f-fabd-423d-ae2b-d7d7e8ea0a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a3510f-fabd-423d-ae2b-d7d7e8ea0a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaf953d-35ee-4e4f-86cf-19ba30795b3a', 'volume_name': 'volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43431ac4-d0b1-4c23-b6a9-8624202265ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43431ac4-d0b1-4c23-b6a9-8624202265ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854ebcc4-6c2e-4290-b44f-e4fdc21cd0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Volume 0eaf953d-35ee-4e4f-86cf-19ba30795b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a', 'volume_size': 1}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "cinder-quobyte-254b3037-c148-4d24-9310-3621362710fe" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c760bcd-934a-40af-91be-09aa6d03d6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb42736e-b689-4785-a430-a331e213f822', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a89bb-cd15-4b40-ad49-c94dea9366e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3888c626-2e49-4539-9fd3-eca57a871086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730504026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fd3216-54f7-46a1-9fec-e97052a89ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:18Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d4944-51f7-42f0-b8b3-32ad342a5786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5d4944-51f7-42f0-b8b3-32ad342a5786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87fb41f-d01d-4c20-9396-e2e6147af06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87fb41f-d01d-4c20-9396-e2e6147af06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fd3216-54f7-46a1-9fec-e97052a89ba8', 'volume_name': 'volume-53fd3216-54f7-46a1-9fec-e97052a89ba8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a582d69-71ae-4d7d-9b17-12cd25a8821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a582d69-71ae-4d7d-9b17-12cd25a8821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f93e622-9c57-4b6d-88aa-0f24e64a8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:20 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Volume 53fd3216-54f7-46a1-9fec-e97052a89ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fd3216-54f7-46a1-9fec-e97052a89ba8', 'volume_size': 1}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:20 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Volume volume-cb42736e-b689-4785-a430-a331e213f822 (cb42736e-b689-4785-a430-a331e213f822): created successfully
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a89bb-cd15-4b40-ad49-c94dea9366e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (a8b90c83-9f41-42c9-b10f-f4654a7348ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932 1073741824" returned: 0 in 0.906s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "cinder-quobyte-254b3037-c148-4d24-9310-3621362710fe" acquired by "delete_volume" :: waited 0.320s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-863531da-ef53-4571-9c92-55e9f0d33175 tempest-CreateVolumesFromImageTest-2063413908 None] Created volume successfully.
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c4730-08bd-4a3b-84c9-c9a8247dcec5]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932" returned: 0 in 0.458s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] <== create_volume: return (1427ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575840827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaf953d-35ee-4e4f-86cf-19ba30795b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:18Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Creating volume 0eaf953d-35ee-4e4f-86cf-19ba30795b3a {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:20 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:21 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=96, name=volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ccb009-329c-4ce2-a5ed-d25cbd3c2beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc693d6-6eba-4875-9611-17df25dd0932', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dfa1de-2d1b-4c28-888d-39accc521e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a 1073741824" returned: 0 in 0.566s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:21 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Volume volume-ebc693d6-6eba-4875-9611-17df25dd0932 (ebc693d6-6eba-4875-9611-17df25dd0932): created successfully
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03dfa1de-2d1b-4c28-888d-39accc521e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (7fd7c8be-ea1d-44b0-85bb-8f49abe8ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe" returned: 0 in 1.461s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" returned: 0 in 0.487s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] <== create_volume: return (1197ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730504026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fd3216-54f7-46a1-9fec-e97052a89ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1d6db2fbcc4b3e87dbf22580ff18ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:18Z,use_quota=True,user_id='7eec2654746c4312ba9e45a7d45e1b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Creating volume 53fd3216-54f7-46a1-9fec-e97052a89ba8 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:22 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:22 devstack quobyte-client[82918]: System call of process 96204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:22 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=97, name=volume-53fd3216-54f7-46a1-9fec-e97052a89ba8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-24e72597-f938-43e6-bc97-427fa8365c44 tempest-CreateVolumesFromImageTest-2063413908 None] Created volume successfully.
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854ebcc4-6c2e-4290-b44f-e4fdc21cd0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276cff88-7724-4aae-b33f-9a7f28869a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-254b3037-c148-4d24-9310-3621362710fe" returned: 0 in 0.879s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:22 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Volume volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a (0eaf953d-35ee-4e4f-86cf-19ba30795b3a): created successfully
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276cff88-7724-4aae-b33f-9a7f28869a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:22 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (7d7f71b3-eb2f-4a3c-9638-00917c473468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "cinder-quobyte-254b3037-c148-4d24-9310-3621362710fe" released by "delete_volume" :: held 2.737s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 1073741824" returned: 0 in 0.783s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-dd5e0145-4fb5-49d4-b8b5-469f704d5d47 tempest-CreateVolumesFromImageTest-2063413908 None] Created volume successfully.
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8" returned: 0 in 0.417s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] <== create_volume: return (1235ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f93e622-9c57-4b6d-88aa-0f24e64a8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fd3216-54f7-46a1-9fec-e97052a89ba8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb661c66-1d2e-4133-8618-d78b0f31ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:23 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Volume volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 (53fd3216-54f7-46a1-9fec-e97052a89ba8): created successfully
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb661c66-1d2e-4133-8618-d78b0f31ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Flow 'volume_create_manager' (f0186b73-eb21-472e-b914-c2b4b6e24b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7b94ba26-da66-4b31-9720-f99933bc64a0 tempest-CreateVolumesFromImageTest-2063413908 None] Created volume successfully.
Sep 10 17:40:23 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Created reservations ['8d854b6b-e56c-4f37-b34d-d2c48b944101', '4d522df1-0cd2-4481-b453-f79ddf6e1c13', '07161521-94bf-4969-9889-513b577cbcca', 'bc46b4fb-222c-4c6b-8716-b871e0afdc28'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.125s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:24 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Deleted volume successfully.
Sep 10 17:40:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a262d1d8-70d8-4718-bd54-6c8370c31422 tempest-TestMinimumBasicScenario-831063047 None] Lock "cinder-254b3037-c148-4d24-9310-3621362710fe-delete_volume" released by "delete_volume" :: held 5.582s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-53fd3216-54f7-46a1-9fec-e97052a89ba8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-53fd3216-54f7-46a1-9fec-e97052a89ba8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:25 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-quobyte-53fd3216-54f7-46a1-9fec-e97052a89ba8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-53fd3216-54f7-46a1-9fec-e97052a89ba8" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2027e2f-7941-424c-bc4f-c0d31343eb32]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8" returned: 0 in 1.913s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-53fd3216-54f7-46a1-9fec-e97052a89ba8" returned: 0 in 0.296s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-53fd3216-54f7-46a1-9fec-e97052a89ba8" released by "delete_volume" :: held 2.589s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Created reservations ['1a52ace5-d7ca-4ca6-865a-80a2fc1e85a5', '5b6b36c8-9f4e-46cf-a231-25f3def8c7c6', '34aa1e39-d3b9-46e8-b3c7-9ff03aef1162', '0da8bb65-7f00-4005-bbae-dfcdd35c4bae'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.338s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:29 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Deleted volume successfully.
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-0eaf953d-35ee-4e4f-86cf-19ba30795b3a-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-0eaf953d-35ee-4e4f-86cf-19ba30795b3a-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5bf4d9d7-a9bf-4c1e-be32-13a4a8d49a06 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-53fd3216-54f7-46a1-9fec-e97052a89ba8-delete_volume" released by "delete_volume" :: held 4.956s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-quobyte-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" acquired by "delete_volume" :: waited 0.147s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e1f8d-47fb-4c1a-a61e-cfb83b6d5d6a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" returned: 0 in 0.563s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" returned: 0 in 0.114s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-0eaf953d-35ee-4e4f-86cf-19ba30795b3a" released by "delete_volume" :: held 0.947s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:31 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Created reservations ['5f30f09f-5f75-4382-bc0b-f8267a1f966d', '3e7711dd-8b8f-4c07-ad4f-230a6711a3cb', '3d495604-7aa1-4626-9c54-b116d206b9e8', 'c8d8598b-8e0f-41de-84f9-7105dd868af1'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.129s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Deleted volume successfully.
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2f7e3bd8-2cd7-487a-be89-313ece7c65cd tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-0eaf953d-35ee-4e4f-86cf-19ba30795b3a-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-ebc693d6-6eba-4875-9611-17df25dd0932-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-ebc693d6-6eba-4875-9611-17df25dd0932-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:33 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-quobyte-ebc693d6-6eba-4875-9611-17df25dd0932" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-ebc693d6-6eba-4875-9611-17df25dd0932" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca68cf-a705-4b31-9044-783d824696c3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932" returned: 0 in 0.616s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ebc693d6-6eba-4875-9611-17df25dd0932" returned: 0 in 0.106s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-ebc693d6-6eba-4875-9611-17df25dd0932" released by "delete_volume" :: held 0.911s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Created reservations ['ab6f51f2-204a-448c-979d-7c9c5fa6ad5c', '9d0e3f5a-7adf-4e5d-b349-921dc783894c', '80979f7a-adf6-4eb7-b747-db01e740e885', 'bae045f7-45b6-4bbb-8d3e-87c3720e1c98'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.104s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Deleted volume successfully.
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8f4ff92e-8b88-4758-9239-67476395f55e tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-ebc693d6-6eba-4875-9611-17df25dd0932-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-cb42736e-b689-4785-a430-a331e213f822-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-cb42736e-b689-4785-a430-a331e213f822-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-quobyte-cb42736e-b689-4785-a430-a331e213f822" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-cb42736e-b689-4785-a430-a331e213f822" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db6da2d-47a3-4432-b538-e4e0d10b9f6d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822" returned: 0 in 1.079s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-cb42736e-b689-4785-a430-a331e213f822" returned: 0 in 0.210s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-cb42736e-b689-4785-a430-a331e213f822" released by "delete_volume" :: held 1.607s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Created reservations ['428dd165-0c30-4d06-b202-d7940f924246', '3beaf60f-eb2a-44c1-a0e5-ad47ae351d11', 'b7a3c72c-0dc6-46b1-9ccc-9ec18909a113', '741058aa-cebc-4f54-bfa6-a827ea9571bd'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.313s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:38 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:39 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Deleted volume successfully.
Sep 10 17:40:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-3656ba13-3334-4e3d-9d0a-125684b21b81-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a585f91c-0bd2-4a14-8a95-f3db118ea3ab tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-cb42736e-b689-4785-a430-a331e213f822-delete_volume" released by "delete_volume" :: held 4.523s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-3656ba13-3334-4e3d-9d0a-125684b21b81-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (087a1e8d-dd15-44e1-b1bf-116032a9253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1591230f-5674-4e19-a7b5-e190ee7c4b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1591230f-5674-4e19-a7b5-e190ee7c4b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1330761607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f877179-b34d-431b-ab05-3d1330c7d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:40Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bfb2f8-ad49-4d03-b278-3a7301586e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bfb2f8-ad49-4d03-b278-3a7301586e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4752775-9d1d-47a3-b193-84d1c165ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4752775-9d1d-47a3-b193-84d1c165ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f877179-b34d-431b-ab05-3d1330c7d5ae', 'volume_name': 'volume-9f877179-b34d-431b-ab05-3d1330c7d5ae', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc867e9-2d3a-4630-b072-508e1782c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc867e9-2d3a-4630-b072-508e1782c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b97a8bc-1262-49d1-b452-c634cc7b0f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Volume 9f877179-b34d-431b-ab05-3d1330c7d5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f877179-b34d-431b-ab05-3d1330c7d5ae', 'volume_size': 1}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1330761607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f877179-b34d-431b-ab05-3d1330c7d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:40Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Creating volume 9f877179-b34d-431b-ab05-3d1330c7d5ae {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:40 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:41 devstack quobyte-client[82918]: System call of process 96298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:41 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=98, name=volume-9f877179-b34d-431b-ab05-3d1330c7d5ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:41 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "cinder-quobyte-3656ba13-3334-4e3d-9d0a-125684b21b81" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:40:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae 1073741824" returned: 0 in 0.932s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-3656ba13-3334-4e3d-9d0a-125684b21b81" acquired by "delete_volume" :: waited 0.525s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8689747-b6f8-497a-a0ba-703497e5b3b6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae" returned: 0 in 0.648s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] <== create_volume: return (1762ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b97a8bc-1262-49d1-b452-c634cc7b0f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f877179-b34d-431b-ab05-3d1330c7d5ae', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d49975-6a2c-469d-9b60-e603c7288348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:42 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Volume volume-9f877179-b34d-431b-ab05-3d1330c7d5ae (9f877179-b34d-431b-ab05-3d1330c7d5ae): created successfully
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d49975-6a2c-469d-9b60-e603c7288348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (087a1e8d-dd15-44e1-b1bf-116032a9253c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:42 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9f6608db-d2df-4549-a62d-6c8b497c669e tempest-AttachVolumeNegativeTest-1477211521 None] Created volume successfully.
Sep 10 17:40:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81" returned: 0 in 1.066s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3656ba13-3334-4e3d-9d0a-125684b21b81" returned: 0 in 0.206s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-quobyte-3656ba13-3334-4e3d-9d0a-125684b21b81" released by "delete_volume" :: held 1.648s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:43 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Created reservations ['0930ff99-e05e-4bf4-82e9-10b84e1a4838', '44b5c192-fbc6-44a9-8d16-696c339edd40', '79649701-1739-4f3e-87d5-c32cd3fb18c0', 'b92cf4a6-40c1-4854-b66b-5aa441a6bda1'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:44 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:40:44 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Deleted volume successfully.
Sep 10 17:40:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fb5bed21-b415-4051-bf7d-f35a74811c67 tempest-CreateVolumesFromImageTest-2063413908 None] Lock "cinder-3656ba13-3334-4e3d-9d0a-125684b21b81-delete_volume" released by "delete_volume" :: held 4.944s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b263dd-9ffb-4b3b-8177-6d2edc9ffafd]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae" returned: 0 in 0.588s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.668s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-9f877179-b34d-431b-ab05-3d1330c7d5ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c7c98c3-4590-40ff-ad27-2dbd3a68357e', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:40:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-7a39d701-2358-4c8a-87ad-3981afd679c8 req-0198cd8f-507b-49d8-a8b0-162ae195a80c tempest-AttachVolumeNegativeTest-1477211521 None] attachment_update completed successfully.
Sep 10 17:40:51 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (8eb1638c-c4fc-4ad3-9660-2ca0c7967fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4167e022-4cbd-4535-9de1-7e629a981a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4167e022-4cbd-4535-9de1-7e629a981a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383547929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:51Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2613b41b-cc08-46ce-887a-cbea6baf90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2613b41b-cc08-46ce-887a-cbea6baf90a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae321f81-8843-4d78-a235-e5be4b73ad6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae321f81-8843-4d78-a235-e5be4b73ad6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3', 'volume_name': 'volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dadbb3-7c05-409e-a21a-cab88c11fb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61dadbb3-7c05-409e-a21a-cab88c11fb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19232f9-13a9-4992-8094-be539458a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume 4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3', 'volume_size': 1}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383547929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:51Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume 4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:51 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:51 devstack quobyte-client[82918]: System call of process 96543 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:51 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=99, name=volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 1073741824" returned: 0 in 0.706s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" returned: 0 in 0.114s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (904ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19232f9-13a9-4992-8094-be539458a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9a2459-44fb-4c75-a596-d4f321c43a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 (4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3): created successfully
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9a2459-44fb-4c75-a596-d4f321c43a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (8eb1638c-c4fc-4ad3-9660-2ca0c7967fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-04ea67ce-d824-40d6-ade8-57fe5afad026 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:40:54 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (c89442ec-f7bf-4784-b655-0c2beed5d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf4dda5-4774-4ba2-9c7f-a6d7b6120c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf4dda5-4774-4ba2-9c7f-a6d7b6120c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121475697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d41f07-2705-42ac-9fbf-e43c82138279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:54Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d39be72-6dbf-40a8-ad60-1916dbd4c732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d39be72-6dbf-40a8-ad60-1916dbd4c732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbb0c20-26b5-4363-b79e-8fcd09e73c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbb0c20-26b5-4363-b79e-8fcd09e73c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d41f07-2705-42ac-9fbf-e43c82138279', 'volume_name': 'volume-e4d41f07-2705-42ac-9fbf-e43c82138279', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08b3ec6-29e4-48e3-b30e-9abe4e408963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08b3ec6-29e4-48e3-b30e-9abe4e408963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faff3fd5-7116-4009-a060-0025b079fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:54 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume e4d41f07-2705-42ac-9fbf-e43c82138279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d41f07-2705-42ac-9fbf-e43c82138279', 'volume_size': 1}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1121475697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d41f07-2705-42ac-9fbf-e43c82138279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:54Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume e4d41f07-2705-42ac-9fbf-e43c82138279 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:54 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:54 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=100, name=volume-e4d41f07-2705-42ac-9fbf-e43c82138279, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279 1073741824" returned: 0 in 0.659s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279" returned: 0 in 0.841s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (1612ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (40d1af4a-9d43-47ba-8e01-74615e0f8884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d97b99-e0bb-4a9c-963a-864ed500a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d97b99-e0bb-4a9c-963a-864ed500a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765046597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850ee6fc-4c91-4972-b1c5-a4dd893af324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:56Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fa2189-9383-490c-9a25-b43abaace6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fa2189-9383-490c-9a25-b43abaace6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc38fbe-e4cd-443e-b1e9-1fe5fe6e5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc38fbe-e4cd-443e-b1e9-1fe5fe6e5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850ee6fc-4c91-4972-b1c5-a4dd893af324', 'volume_name': 'volume-850ee6fc-4c91-4972-b1c5-a4dd893af324', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312f6739-58bc-4a3c-addc-58e4f03ed3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312f6739-58bc-4a3c-addc-58e4f03ed3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c61ecf-ba21-496d-80f9-b4cc2b11126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:56 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume 850ee6fc-4c91-4972-b1c5-a4dd893af324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850ee6fc-4c91-4972-b1c5-a4dd893af324', 'volume_size': 1}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765046597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850ee6fc-4c91-4972-b1c5-a4dd893af324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:56Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume 850ee6fc-4c91-4972-b1c5-a4dd893af324 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:56 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:56 devstack quobyte-client[82918]: System call of process 96717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:56 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=101, name=volume-850ee6fc-4c91-4972-b1c5-a4dd893af324, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (2cbf79f0-8cd3-4afb-8a21-9cf37c39769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de19e1f-a934-4203-a5fc-f2d6c968ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faff3fd5-7116-4009-a060-0025b079fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d41f07-2705-42ac-9fbf-e43c82138279', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2a043f-4c87-49ac-8cad-9a008416693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de19e1f-a934-4203-a5fc-f2d6c968ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675779827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07536ae1-d0e8-4b6e-af3c-bd178c8ea430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:55Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c51414-fda8-43a5-9a47-00ab9caf2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c51414-fda8-43a5-9a47-00ab9caf2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe09723-e787-4d39-96c6-10260cd73f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe09723-e787-4d39-96c6-10260cd73f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07536ae1-d0e8-4b6e-af3c-bd178c8ea430', 'volume_name': 'volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d494cd4-5c30-4bcc-aee3-783e0dcb6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d494cd4-5c30-4bcc-aee3-783e0dcb6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fb42eb-0936-4c78-a4fa-1399ddc63bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume 07536ae1-d0e8-4b6e-af3c-bd178c8ea430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430', 'volume_size': 1}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-e4d41f07-2705-42ac-9fbf-e43c82138279 (e4d41f07-2705-42ac-9fbf-e43c82138279): created successfully
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2a043f-4c87-49ac-8cad-9a008416693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (c89442ec-f7bf-4784-b655-0c2beed5d2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 1073741824" returned: 0 in 1.506s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (0f25f822-24e2-4c7b-ae5d-2c6d4bc65783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e8177b-e268-48cd-8bab-2ece5830e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (ffef28d5-b9c2-4510-bdc7-1020d104cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd7ea5-726e-4c5e-9e33-764734b1e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324" returned: 0 in 0.730s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0f026b34-8277-4d8c-9491-1ccd5bfe025f tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (2283ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1675779827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07536ae1-d0e8-4b6e-af3c-bd178c8ea430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:55Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume 07536ae1-d0e8-4b6e-af3c-bd178c8ea430 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:40:58 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:40:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:58 devstack quobyte-client[82918]: System call of process 96723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:40:58 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=102, name=volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fcd7ea5-726e-4c5e-9e33-764734b1e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1703232028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6720a54b-88bf-4a34-9fa9-f6539e023e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:57Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8ce8f4-8b6b-424e-80cf-32bfd22f3cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8ce8f4-8b6b-424e-80cf-32bfd22f3cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcca1c70-3805-438a-ab90-2f289ec234e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcca1c70-3805-438a-ab90-2f289ec234e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6720a54b-88bf-4a34-9fa9-f6539e023e9e', 'volume_name': 'volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91485228-21c4-4085-8112-95cecf0dbd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91485228-21c4-4085-8112-95cecf0dbd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1452a0-f47d-4fc0-af86-a661cf560ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume 6720a54b-88bf-4a34-9fa9-f6539e023e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e', 'volume_size': 1}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e8177b-e268-48cd-8bab-2ece5830e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825229817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e3f06-f0c5-40d9-aed5-6f958c3059aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:56Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9759323b-d26a-4c0c-b15e-d7057213b77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9759323b-d26a-4c0c-b15e-d7057213b77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25f41ef-a44c-4c0f-9559-02e239faf2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25f41ef-a44c-4c0f-9559-02e239faf2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9e3f06-f0c5-40d9-aed5-6f958c3059aa', 'volume_name': 'volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4420bdf-b227-4446-88dd-eef4539d100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4420bdf-b227-4446-88dd-eef4539d100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c94b4c-d352-4ae1-b766-4fbf3c9915f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume 2e9e3f06-f0c5-40d9-aed5-6f958c3059aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa', 'volume_size': 1}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c61ecf-ba21-496d-80f9-b4cc2b11126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850ee6fc-4c91-4972-b1c5-a4dd893af324', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7194cd48-9e07-4164-b0b8-ec43db36c26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 1073741824" returned: 0 in 0.787s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:40:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 (850ee6fc-4c91-4972-b1c5-a4dd893af324): created successfully
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7194cd48-9e07-4164-b0b8-ec43db36c26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (40d1af4a-9d43-47ba-8e01-74615e0f8884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" returned: 0 in 0.512s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (1331ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:40:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1703232028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6720a54b-88bf-4a34-9fa9-f6539e023e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:57Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume 6720a54b-88bf-4a34-9fa9-f6539e023e9e {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:41:00 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1463a069-0afc-4ace-86be-65ebb8438aab tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:41:00 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=103, name=volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fb42eb-0936-4c78-a4fa-1399ddc63bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e857c6-ebba-467b-ba36-fd69c009c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e 1073741824" returned: 0 in 0.659s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 (07536ae1-d0e8-4b6e-af3c-bd178c8ea430): created successfully
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e857c6-ebba-467b-ba36-fd69c009c99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (2cbf79f0-8cd3-4afb-8a21-9cf37c39769a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e" returned: 0 in 0.573s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (1260ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825229817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e3f06-f0c5-40d9-aed5-6f958c3059aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3208f8f24d4a3282b09bc2e9d9e4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:40:56Z,use_quota=True,user_id='e365e4f0a08d4652bba2d25b1c1403a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Creating volume 2e9e3f06-f0c5-40d9-aed5-6f958c3059aa {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:41:01 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:01 devstack quobyte-client[82918]: System call of process 96736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:01 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=104, name=volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:41:01 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7c45864a-4c07-4042-a24e-68b364deb17d tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1452a0-f47d-4fc0-af86-a661cf560ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321419be-22aa-4bc3-a611-035b5fe658a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:01 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e (6720a54b-88bf-4a34-9fa9-f6539e023e9e): created successfully
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321419be-22aa-4bc3-a611-035b5fe658a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (ffef28d5-b9c2-4510-bdc7-1020d104cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa 1073741824" returned: 0 in 0.649s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" returned: 0 in 0.206s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c94b4c-d352-4ae1-b766-4fbf3c9915f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c2daf0-8c43-4abf-a328-183138512954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-61493048-86f3-4b69-889d-ec7d8c48e76c tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:41:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa (2e9e3f06-f0c5-40d9-aed5-6f958c3059aa): created successfully
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c2daf0-8c43-4abf-a328-183138512954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Flow 'volume_create_manager' (0f25f822-24e2-4c7b-ae5d-2c6d4bc65783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:41:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d3ec0287-cefb-474f-92e8-6fa1b53bc252 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created volume successfully.
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.158s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-6720a54b-88bf-4a34-9fa9-f6539e023e9e-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:03 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-6720a54b-88bf-4a34-9fa9-f6539e023e9e-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-6720a54b-88bf-4a34-9fa9-f6539e023e9e" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-6720a54b-88bf-4a34-9fa9-f6539e023e9e" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b213e0-3c93-44d7-bb89-c0a8442ad4a3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:04 devstack quobyte-client[82918]: System call of process 96773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e" returned: 0 in 0.520s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6720a54b-88bf-4a34-9fa9-f6539e023e9e" returned: 0 in 0.152s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-6720a54b-88bf-4a34-9fa9-f6539e023e9e" released by "delete_volume" :: held 0.911s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['f2f058ef-f17b-4b65-ab1f-9229ecbc94a0', 'c1b4fb64-3379-47c0-a16f-0f671414d3a0', '7e2e8123-6d58-4527-ba61-6a3897a7b442', '083b2d15-82a2-4492-b8b5-a69df9137e5c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-05100a1e-cb39-42a6-8010-2d9070dc35c7 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-6720a54b-88bf-4a34-9fa9-f6539e023e9e-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:06 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[918f8887-1a5d-43dd-9549-f0d8e9992c4c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" returned: 0 in 0.570s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" returned: 0 in 0.131s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa" released by "delete_volume" :: held 0.934s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['57ffa399-2c20-4a2a-9b52-2d7b77dba121', '7a52d218-4939-424a-a8a8-b2cd81b9bbfc', '807cd06b-20e5-4d43-9557-6c582653d7a0', '055c6054-8805-4b36-a31f-3949e931fbac'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.163s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-850ee6fc-4c91-4972-b1c5-a4dd893af324-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-850ee6fc-4c91-4972-b1c5-a4dd893af324-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b2f56e51-c034-4cb3-bb5f-bb3be068f221 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-2e9e3f06-f0c5-40d9-aed5-6f958c3059aa-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-850ee6fc-4c91-4972-b1c5-a4dd893af324" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-850ee6fc-4c91-4972-b1c5-a4dd893af324" acquired by "delete_volume" :: waited 0.027s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[31971bfb-c2d5-4fcf-bc70-4d2554fba22f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324" returned: 0 in 0.500s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-850ee6fc-4c91-4972-b1c5-a4dd893af324" returned: 0 in 0.124s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-850ee6fc-4c91-4972-b1c5-a4dd893af324" released by "delete_volume" :: held 0.908s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['24eefcb4-cae6-4ccd-9723-c48d89b4f80b', '5a36af95-b921-4919-a716-55ef42bfeaa0', 'fa12bab6-cbd7-434d-9525-ea90bad7e4a1', '5db31732-3353-41b3-9f5f-c6e9321a2d6c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.165s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-07536ae1-d0e8-4b6e-af3c-bd178c8ea430-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-70db61fd-cb3e-4d9a-8ede-d0e0bf2faa45 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-850ee6fc-4c91-4972-b1c5-a4dd893af324-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-07536ae1-d0e8-4b6e-af3c-bd178c8ea430-delete_volume" acquired by "delete_volume" :: waited 0.333s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=62,cinder:UPDATE=100,cinder:DELETE=13,cinder:INSERT=24 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:41:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" acquired by "delete_volume" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:12 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0da613-c831-4436-9051-f1a6e93a087e]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:12 devstack quobyte-client[82918]: System call of process 96833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" returned: 0 in 0.854s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" returned: 0 in 0.140s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-07536ae1-d0e8-4b6e-af3c-bd178c8ea430" released by "delete_volume" :: held 1.175s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=69,cinder:UPDATE=97,cinder:DELETE=8,cinder:INSERT=12 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['364d251c-32ac-4eda-931e-4a21bf8b66d9', '13cb0f6b-835e-433a-9ad5-12c107a55571', 'e93aefa4-aef9-4e52-b7a6-802063ccf992', 'c12ae2c8-d7ec-4486-a5db-5334d4256d24'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-e4d41f07-2705-42ac-9fbf-e43c82138279-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.447s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-e4d41f07-2705-42ac-9fbf-e43c82138279-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f6721db1-6100-4d70-8a5e-316d7cc7ed82 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-07536ae1-d0e8-4b6e-af3c-bd178c8ea430-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-e4d41f07-2705-42ac-9fbf-e43c82138279" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-e4d41f07-2705-42ac-9fbf-e43c82138279" acquired by "delete_volume" :: waited 0.022s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bffbb8-de0d-4cc3-b2d5-f5f5eb49ea78]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:15 devstack quobyte-client[82918]: System call of process 96838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279" returned: 0 in 0.549s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e4d41f07-2705-42ac-9fbf-e43c82138279" returned: 0 in 0.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-e4d41f07-2705-42ac-9fbf-e43c82138279" released by "delete_volume" :: held 0.856s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['bc77670b-ac16-461c-b8a1-128b208dc837', '07d3e88e-1192-4d10-be90-462d93729bea', '457193e4-9b72-443e-9aa6-b5aae2c278ee', 'b2def637-00c2-4839-b696-b13c801ccfc9'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.108s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:16 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-df06409f-c8f4-4561-aac9-aa819b559fa2 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-e4d41f07-2705-42ac-9fbf-e43c82138279-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "cinder-quobyte-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" acquired by "delete_volume" :: waited 0.031s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1aaad-3f90-400a-92e4-debe69cac59f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" returned: 0 in 0.512s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" returned: 0 in 0.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-quobyte-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3" released by "delete_volume" :: held 0.821s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Created reservations ['37f2f69a-054e-47f1-aeb0-3bbac07b2928', '63ffae19-9b79-400b-93b9-6ba8de18d341', '3efe62ee-ef8e-4d37-b947-5e7218689b58', '28396c8e-9654-4530-8b33-df2b4db85e86'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.136s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:41:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Deleted volume successfully.
Sep 10 17:41:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-77a6c0d2-16af-4721-8626-6bb91329ac14 tempest-CreateVolumesFromSourceVolumeTest-485304938 None] Lock "cinder-4bbd12e0-3f8f-4c8d-900a-cd6d4edc40d3-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:41:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-5ec32b30-de61-4027-b9b4-0e43e2c4f58a req-8e49b34b-fb9e-4d15-aeba-7f27a87f4ac4 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-5ec32b30-de61-4027-b9b4-0e43e2c4f58a req-8e49b34b-fb9e-4d15-aeba-7f27a87f4ac4 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:21 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-5ec32b30-de61-4027-b9b4-0e43e2c4f58a req-8e49b34b-fb9e-4d15-aeba-7f27a87f4ac4 tempest-AttachVolumeNegativeTest-1477211521 None] Terminate volume connection completed successfully.
Sep 10 17:41:21 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5ec32b30-de61-4027-b9b4-0e43e2c4f58a req-8e49b34b-fb9e-4d15-aeba-7f27a87f4ac4 tempest-AttachVolumeNegativeTest-1477211521 None] Deleting attachment 5c7c98c3-4590-40ff-ad27-2dbd3a68357e. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:41:31 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:INSERT=7,cinder:UPDATE=24,cinder:SELECT=10,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:41:31 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:41:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Flow 'volume_create_manager' (34bd6ae1-ae7d-4b34-8735-b96d2863d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b6b692-a36f-483f-b9c2-b2b6f581b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b6b692-a36f-483f-b9c2-b2b6f581b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1685921898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d903f-ec83-4c07-b64c-38834e746067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cecbe63eb6549fbbbd47dd26b8d8814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:41:45Z,use_quota=True,user_id='b956edd3ee2b457fa3d17802557a5853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a989df8-86bb-46bb-9daa-e79f74d61999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a989df8-86bb-46bb-9daa-e79f74d61999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7693ee-36b5-4079-86d0-74f00990853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7693ee-36b5-4079-86d0-74f00990853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d9d903f-ec83-4c07-b64c-38834e746067', 'volume_name': 'volume-0d9d903f-ec83-4c07-b64c-38834e746067', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039861dff0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d799ad-e767-477b-9849-dc2f06f5a982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d799ad-e767-477b-9849-dc2f06f5a982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7d7726-002f-423e-a312-76879ac56c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:45 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Volume 0d9d903f-ec83-4c07-b64c-38834e746067: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d9d903f-ec83-4c07-b64c-38834e746067', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039861dff0>}
Sep 10 17:41:45 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Cloning 0d9d903f-ec83-4c07-b64c-38834e746067 from image 3a863299-f273-4a78-81cf-9aa7d2a025e9  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:41:46 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:41:46 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 17:41:46 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[945bd142-d236-482c-9bbc-6cf9310cb27c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:46 devstack sudo[96905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD
Sep 10 17:41:46 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:41:48 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root
Sep 10 17:41:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD" returned: 0 in 2.255s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:48 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 is fetched for user b956edd3ee2b457fa3d17802557a5853. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:41:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1585f56-8fe3-4193-8d7a-69e13b363e65]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:49 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD
Sep 10 17:41:49 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:41:51 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD" returned: 0 in 2.704s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1685921898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d903f-ec83-4c07-b64c-38834e746067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cecbe63eb6549fbbbd47dd26b8d8814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:41:45Z,use_quota=True,user_id='b956edd3ee2b457fa3d17802557a5853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Creating volume 0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:41:51 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:41:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:51 devstack quobyte-client[82918]: System call of process 96922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:52 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=105, name=volume-0d9d903f-ec83-4c07-b64c-38834e746067, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 1073741824" returned: 0 in 0.498s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.143s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:41:52 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Attempting download of 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 0d9d903f-ec83-4c07-b64c-38834e746067. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:41:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2dd223-8e83-4f5a-9a56-18af3f94a3b7]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_9py4s5xm {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_9py4s5xm" returned: 0 in 0.824s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_9py4s5xm {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_9py4s5xm" returned: 1 in 0.350s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a863299-f273-4a78-81cf-9aa7d2a025e9_9py4s5xm' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[108beceb-2dd4-49ed-a636-59773c9e70d3]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] 3a863299-f273-4a78-81cf-9aa7d2a025e9 was qcow2, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:41:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:55 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=105, name=volume-0d9d903f-ec83-4c07-b64c-38834e746067, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 1.429s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a863299-f273-4a78-81cf-9aa7d2a025e9_w7dd5kh8devstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:41:56 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Converted 112.00 MB image at 76.32 MB/s
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:56 devstack quobyte-client[82918]: System call of process 96951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 1G" returned: 0 in 0.141s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8581d7-4e17-48c1-9498-dbd271ee148b]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:41:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.447s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 1 in 0.414s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Downloaded image 3a863299-f273-4a78-81cf-9aa7d2a025e9 ((None, None)) to volume 0d9d903f-ec83-4c07-b64c-38834e746067 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Temporary image 3a863299-f273-4a78-81cf-9aa7d2a025e9 for user b956edd3ee2b457fa3d17802557a5853 is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Marking volume 0d9d903f-ec83-4c07-b64c-38834e746067 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Copying metadata from image 3a863299-f273-4a78-81cf-9aa7d2a025e9 to 0d9d903f-ec83-4c07-b64c-38834e746067. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:41:57 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Creating volume glance metadata for volume 0d9d903f-ec83-4c07-b64c-38834e746067 backed by image 3a863299-f273-4a78-81cf-9aa7d2a025e9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:41:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7d7726-002f-423e-a312-76879ac56c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9d903f-ec83-4c07-b64c-38834e746067', 'volume_size': 1, 'image_id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a57264875d6e4e40b5317dd69671a575', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a863299-f273-4a78-81cf-9aa7d2a025e9', 'created_at': datetime.datetime(2025, 9, 10, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 2, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a863299-f273-4a78-81cf-9aa7d2a025e9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f039861dff0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd86ad13-d737-4c59-99b9-3e6200e777e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:41:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Volume volume-0d9d903f-ec83-4c07-b64c-38834e746067 (0d9d903f-ec83-4c07-b64c-38834e746067): created successfully
Sep 10 17:41:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd86ad13-d737-4c59-99b9-3e6200e777e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:41:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Flow 'volume_create_manager' (34bd6ae1-ae7d-4b34-8735-b96d2863d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:41:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-71bddf7f-932f-4b2e-9c5c-9bf85225ccda tempest-TestShelveInstance-583346975 None] Created volume successfully.
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.206s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:42:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:42:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=8,cinder:INSERT=7,cinder:UPDATE=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:42:08 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1dda87-110d-4970-9a5c-6a572f69335b]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.573s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:42:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:42:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 1 in 0.899s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:42:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:42:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.751s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:42:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-0d9d903f-ec83-4c07-b64c-38834e746067', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d92eebd-299a-4a95-8074-e93982f4fbd8', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:42:12 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:42:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-e3310c72-aae3-4fce-90e2-1f801e59c290 req-bac82153-5860-48ab-a795-f79ad83d1b44 tempest-TestShelveInstance-583346975 None] attachment_update completed successfully.
Sep 10 17:42:23 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:42:23 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:42:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:42:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.144s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:43:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:43:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (46855321-8f1d-410a-bd36-7b74599cae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c60d33d-85a5-40f3-bb68-886bdc900d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c60d33d-85a5-40f3-bb68-886bdc900d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-166578014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a1e3c3-995c-4c35-99a2-d53ef487092c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:43:18Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb91339-473b-4020-888a-ddb191da6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb91339-473b-4020-888a-ddb191da6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ea8371-3e46-4f63-9ffc-e47e8f9deead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ea8371-3e46-4f63-9ffc-e47e8f9deead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a1e3c3-995c-4c35-99a2-d53ef487092c', 'volume_name': 'volume-11a1e3c3-995c-4c35-99a2-d53ef487092c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c13009-ecdd-4635-980c-1928dd90d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c13009-ecdd-4635-980c-1928dd90d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ac5334-a791-4301-abe7-37c5b2a2d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Volume 11a1e3c3-995c-4c35-99a2-d53ef487092c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a1e3c3-995c-4c35-99a2-d53ef487092c', 'volume_size': 1}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-166578014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a1e3c3-995c-4c35-99a2-d53ef487092c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d830a01eef4e96be2592060c5dfcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:43:18Z,use_quota=True,user_id='a8918177b8474425b725e985f0f537c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Creating volume 11a1e3c3-995c-4c35-99a2-d53ef487092c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:43:18 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:43:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:43:18 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=106, name=volume-11a1e3c3-995c-4c35-99a2-d53ef487092c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c 1073741824" returned: 0 in 0.510s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c" returned: 0 in 0.175s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ac5334-a791-4301-abe7-37c5b2a2d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a1e3c3-995c-4c35-99a2-d53ef487092c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563faa0e-eb67-4dcb-91d4-72a57fd4017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:43:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Volume volume-11a1e3c3-995c-4c35-99a2-d53ef487092c (11a1e3c3-995c-4c35-99a2-d53ef487092c): created successfully
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563faa0e-eb67-4dcb-91d4-72a57fd4017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:43:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Flow 'volume_create_manager' (46855321-8f1d-410a-bd36-7b74599cae62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:43:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-cec7b16f-f033-4bf0-a679-3ed62dc64e63 tempest-AttachVolumeNegativeTest-1477211521 None] Created volume successfully.
Sep 10 17:43:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:43:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:43:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac03b4-533e-4995-b384-1ac2e9bf5255]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:43:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:43:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c" returned: 0 in 0.509s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:43:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.579s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:43:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-11a1e3c3-995c-4c35-99a2-d53ef487092c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34283d5c-6d4a-4f67-8def-d1f68e44acb0', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:43:25 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-b989e936-a659-4c74-a70f-a87d5bf27cd6 req-017abfab-edd5-4291-94f8-b2305a15f76b tempest-AttachVolumeNegativeTest-1477211521 None] attachment_update completed successfully.
Sep 10 17:43:35 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:DELETE=1,cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:43:35 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:43:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-2b663f21-53e7-465d-9427-38f2ac83f0f1 req-a2fdc336-8472-452d-8471-40b09e785939 tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-2b663f21-53e7-465d-9427-38f2ac83f0f1 req-a2fdc336-8472-452d-8471-40b09e785939 tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-2b663f21-53e7-465d-9427-38f2ac83f0f1 req-a2fdc336-8472-452d-8471-40b09e785939 tempest-TestShelveInstance-583346975 None] Terminate volume connection completed successfully.
Sep 10 17:43:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-2b663f21-53e7-465d-9427-38f2ac83f0f1 req-a2fdc336-8472-452d-8471-40b09e785939 tempest-TestShelveInstance-583346975 None] Deleting attachment 2d92eebd-299a-4a95-8074-e93982f4fbd8. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:43:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-9afc1efb-00ff-4059-9213-c67f31a5dd03 req-cf65412b-72cf-4d49-b18a-133af87e5ba7 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-9afc1efb-00ff-4059-9213-c67f31a5dd03 req-cf65412b-72cf-4d49-b18a-133af87e5ba7 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:43:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-9afc1efb-00ff-4059-9213-c67f31a5dd03 req-cf65412b-72cf-4d49-b18a-133af87e5ba7 tempest-AttachVolumeNegativeTest-1477211521 None] Terminate volume connection completed successfully.
Sep 10 17:43:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-9afc1efb-00ff-4059-9213-c67f31a5dd03 req-cf65412b-72cf-4d49-b18a-133af87e5ba7 tempest-AttachVolumeNegativeTest-1477211521 None] Deleting attachment 34283d5c-6d4a-4f67-8def-d1f68e44acb0. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:43:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:43:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:43:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e264d6-d28d-4d68-9bae-75a324f90e42]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:43:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.606s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 1 in 0.676s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:44:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.506s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-0d9d903f-ec83-4c07-b64c-38834e746067', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18dcb44c-118c-4e9a-ba2c-03a795e7d743', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:44:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:01 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-b85a7884-1815-4e10-8384-ea3479c3f29e req-2e9be273-5758-43ab-92ad-2fac66897a0d tempest-TestShelveInstance-583346975 None] attachment_update completed successfully.
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.104s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-11a1e3c3-995c-4c35-99a2-d53ef487092c-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-11a1e3c3-995c-4c35-99a2-d53ef487092c-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-quobyte-11a1e3c3-995c-4c35-99a2-d53ef487092c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-11a1e3c3-995c-4c35-99a2-d53ef487092c" acquired by "delete_volume" :: waited 0.020s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83005c-c243-48b9-a236-dd7d23d5cd85]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c" returned: 0 in 0.416s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-11a1e3c3-995c-4c35-99a2-d53ef487092c" returned: 0 in 0.087s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-11a1e3c3-995c-4c35-99a2-d53ef487092c" released by "delete_volume" :: held 0.652s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Created reservations ['095acd2e-88cd-4284-84f3-8f6969ec525e', 'e2e345d7-3793-482b-8f68-46947f97d6e5', 'bd6f2084-0797-49a4-877d-90a700221b15', 'f542a753-63c9-4870-8ccf-01e347c8749c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:12 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Deleted volume successfully.
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a51e05ce-d057-43fd-a251-8ebb8684e501 tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-11a1e3c3-995c-4c35-99a2-d53ef487092c-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-9f877179-b34d-431b-ab05-3d1330c7d5ae-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-9f877179-b34d-431b-ab05-3d1330c7d5ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-quobyte-9f877179-b34d-431b-ab05-3d1330c7d5ae" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-9f877179-b34d-431b-ab05-3d1330c7d5ae" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d271f50-e24e-41ad-b83f-66fd42e4bb7d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae" returned: 0 in 0.599s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9f877179-b34d-431b-ab05-3d1330c7d5ae" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-9f877179-b34d-431b-ab05-3d1330c7d5ae" released by "delete_volume" :: held 0.885s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Created reservations ['ee2bd649-7df6-4368-9856-661356758f36', '39ec938a-e455-4e4c-8676-a933129d16b3', '53fdb5ca-c05d-4a9c-b87a-44d57f26e68a', '988fc589-6e11-4b6b-a167-f1f3320f01f9'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.125s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Deleted volume successfully.
Sep 10 17:44:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-48f92c51-42d0-4375-9208-cc35e1be74cc tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-9f877179-b34d-431b-ab05-3d1330c7d5ae-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "cinder-quobyte-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" acquired by "delete_volume" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d7800d-78ea-4a42-96e5-ede830430c07]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" returned: 0 in 1.197s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" returned: 0 in 0.401s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-quobyte-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34" released by "delete_volume" :: held 2.111s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Created reservations ['62219527-ad54-4efd-be99-08d7c9525357', 'ecd90828-6c22-4c36-8b46-dd118dc43d8c', '1473f5da-2007-4ebd-a3a2-0fdb3b69797d', '06013cc8-b9e2-42ec-8aad-b1764333db28'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.182s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:19 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Deleted volume successfully.
Sep 10 17:44:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2c5e3ae5-d1ac-4b4c-8f5b-8f825ad232af tempest-AttachVolumeNegativeTest-1477211521 None] Lock "cinder-b2dd22db-b6d5-44fc-bce1-3cca4fa5ae34-delete_volume" released by "delete_volume" :: held 3.925s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:29 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:44:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Flow 'volume_create_manager' (ae68aa9a-6e2a-402a-a899-080ad67d1adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3ea43d-4298-438a-a7f2-92fd854ec9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3ea43d-4298-438a-a7f2-92fd854ec9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-664931548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a20842c-f2f7-47a8-8fce-3afdfd34314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a600b2082ec6485a86a6de8a75f06acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:30Z,use_quota=True,user_id='e656e2df278d43f4a6e4b867fa684b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a67968-4945-4fd6-a2dd-96450c29d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a67968-4945-4fd6-a2dd-96450c29d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb2c2b2-4213-4c78-85d2-65996f6bdbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb2c2b2-4213-4c78-85d2-65996f6bdbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a20842c-f2f7-47a8-8fce-3afdfd34314d', 'volume_name': 'volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0989e6-2605-4a8f-a2bf-078f11082405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0989e6-2605-4a8f-a2bf-078f11082405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104af5ab-4ea7-4d59-951b-e1f9ee90fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:30 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume 5a20842c-f2f7-47a8-8fce-3afdfd34314d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d', 'volume_size': 1}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-664931548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a20842c-f2f7-47a8-8fce-3afdfd34314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a600b2082ec6485a86a6de8a75f06acc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:30Z,use_quota=True,user_id='e656e2df278d43f4a6e4b867fa684b78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Creating volume 5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:44:30 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:30 devstack quobyte-client[82918]: System call of process 98408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:44:30 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=107, name=volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d 1073741824" returned: 0 in 0.407s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d" returned: 0 in 0.105s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:44:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.598s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104af5ab-4ea7-4d59-951b-e1f9ee90fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a20f89d-c179-43a9-9b20-46494a239f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:31 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d (5a20842c-f2f7-47a8-8fce-3afdfd34314d): created successfully
Sep 10 17:44:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a20f89d-c179-43a9-9b20-46494a239f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Flow 'volume_create_manager' (ae68aa9a-6e2a-402a-a899-080ad67d1adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:31 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-5c9b54f0-2663-46b7-a79b-bc2da0cfdcb9 req-97ef4989-2979-4b1b-87fe-0d1ac27df05b tempest-VolumesSnapshotsTestJSON-1209841027 None] Created volume successfully.
Sep 10 17:44:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Creating offline snapshot 50810f21-fc82-44e8-bcea-fd23b0348c86 of volume 5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:44:32 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce448cc-a8ff-4749-9f1d-650793c7d2d6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d" returned: 0 in 0.526s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:33 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=108, name=volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 1G" returned: 0 in 0.375s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "qemu-img rebase -u -b volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.224s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:44:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.085s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.131s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.info" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.info" returned: 0 in 0.174s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-ed1dbb84-4ba1-4c61-aacc-6ea667329bb2 req-07122d22-003a-409e-ac28-6242c4cb572d tempest-VolumesSnapshotsTestJSON-1209841027 None] Create snapshot completed successfully
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "cinder-50810f21-fc82-44e8-bcea-fd23b0348c86-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-50810f21-fc82-44e8-bcea-fd23b0348c86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "cinder-quobyte-50810f21-fc82-44e8-bcea-fd23b0348c86" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-50810f21-fc82-44e8-bcea-fd23b0348c86" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Deleting offline snapshot 50810f21-fc82-44e8-bcea-fd23b0348c86 of volume 5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] snapshot_file for this snap is: volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdd3ae-b019-464f-a97b-31d72d47b628]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.538s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b5e412-6983-412a-b359-1ff95a20b83a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d" returned: 0 in 0.594s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.256s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d.50810f21-fc82-44e8-bcea-fd23b0348c86" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-50810f21-fc82-44e8-bcea-fd23b0348c86" released by "_delete_snapshot" :: held 1.823s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" released by "delete_snapshot" :: held 1.847s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG cinder.quota [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Created reservations ['f90e4e16-3c39-4132-bc3a-c7565a9bea40', '3e5a6630-799a-434d-beb3-7675833f1772', 'a33cee61-e118-4666-b0e6-2073ca9e85a3', 'aef758e1-7671-46d5-89f5-5a4a4c732344'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Delete snapshot completed successfully.
Sep 10 17:44:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-4e0de132-182d-49c4-8562-91cdff42e71c req-404e36bc-baba-40a3-ae8a-c95fcbe6f955 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-50810f21-fc82-44e8-bcea-fd23b0348c86-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "cinder-5a20842c-f2f7-47a8-8fce-3afdfd34314d-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-5a20842c-f2f7-47a8-8fce-3afdfd34314d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[073833d2-8086-4842-955c-1de8332e6a6b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d" returned: 0 in 0.559s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5a20842c-f2f7-47a8-8fce-3afdfd34314d" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-quobyte-5a20842c-f2f7-47a8-8fce-3afdfd34314d" released by "delete_volume" :: held 0.853s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG cinder.quota [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Created reservations ['d78429bf-34cd-4c53-b6e1-10ed3cba2fac', '59f3701e-bf53-461f-b022-98a93f99e23a', '8b596033-edfb-421e-9688-3637152068d9', 'cfff16ff-1e9c-4949-bf5e-2f47b8a3bf5f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.110s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG cinder.manager [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Deleted volume successfully.
Sep 10 17:44:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-9e1825a5-c004-4a68-ae1e-381d79c9ba6d req-052796f9-791e-4a1a-af8e-5d80cc14cf20 tempest-VolumesSnapshotsTestJSON-1209841027 None] Lock "cinder-5a20842c-f2f7-47a8-8fce-3afdfd34314d-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:45 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=34,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:44:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (dd252365-e49c-457a-b75a-44c03a2cf9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610a3ec1-a3ad-4b79-a9fc-328e23525cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610a3ec1-a3ad-4b79-a9fc-328e23525cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1598076717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793a507-8ad3-4541-97ab-c4afa7b566bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:46Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868ec99f-8a83-472f-9b23-69a2c871358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868ec99f-8a83-472f-9b23-69a2c871358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9fc9b2-eb7c-42d6-8e2b-19d99ab4de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9fc9b2-eb7c-42d6-8e2b-19d99ab4de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6793a507-8ad3-4541-97ab-c4afa7b566bc', 'volume_name': 'volume-6793a507-8ad3-4541-97ab-c4afa7b566bc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc711012-2bdf-4954-9105-80d02a1c5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc711012-2bdf-4954-9105-80d02a1c5248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aec2d3-6dc3-4249-8d61-1c7d11d7af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:46 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Volume 6793a507-8ad3-4541-97ab-c4afa7b566bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6793a507-8ad3-4541-97ab-c4afa7b566bc', 'volume_size': 1}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1598076717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793a507-8ad3-4541-97ab-c4afa7b566bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:46Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Creating volume 6793a507-8ad3-4541-97ab-c4afa7b566bc {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:44:46 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:46 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=110, name=volume-6793a507-8ad3-4541-97ab-c4afa7b566bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc 1073741824" returned: 0 in 0.458s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc" returned: 0 in 0.188s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:44:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aec2d3-6dc3-4249-8d61-1c7d11d7af71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6793a507-8ad3-4541-97ab-c4afa7b566bc', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9277cf26-2e46-4d67-9983-e80007e071be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:47 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Volume volume-6793a507-8ad3-4541-97ab-c4afa7b566bc (6793a507-8ad3-4541-97ab-c4afa7b566bc): created successfully
Sep 10 17:44:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9277cf26-2e46-4d67-9983-e80007e071be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (dd252365-e49c-457a-b75a-44c03a2cf9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9d8a44f6-c97b-415d-b907-40dff73405e8 tempest-VolumesTestJSON-1569819612 None] Created volume successfully.
Sep 10 17:44:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (ce4d9c15-5232-40fe-9710-6a96edb05e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eeff40-601b-4189-a7b7-b97ec8c3c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7eeff40-601b-4189-a7b7-b97ec8c3c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322753300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1677336f-a33f-4341-b88e-ad8a931b29cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:49Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce81176-fee6-46bc-88f7-4bd0134689dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce81176-fee6-46bc-88f7-4bd0134689dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d3913d-8920-43b3-8aae-3802405ac9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d3913d-8920-43b3-8aae-3802405ac9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1677336f-a33f-4341-b88e-ad8a931b29cb', 'volume_name': 'volume-1677336f-a33f-4341-b88e-ad8a931b29cb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337b7dd-cb9b-4745-8327-32010ff5d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9337b7dd-cb9b-4745-8327-32010ff5d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534c43b6-b2bc-4fc9-b08d-5b49666f59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:48 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Volume 1677336f-a33f-4341-b88e-ad8a931b29cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1677336f-a33f-4341-b88e-ad8a931b29cb', 'volume_size': 1}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322753300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1677336f-a33f-4341-b88e-ad8a931b29cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:49Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Creating volume 1677336f-a33f-4341-b88e-ad8a931b29cb {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:44:48 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:44:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:49 devstack quobyte-client[82918]: System call of process 98473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:44:49 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=111, name=volume-1677336f-a33f-4341-b88e-ad8a931b29cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb 1073741824" returned: 0 in 0.423s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb" returned: 0 in 0.107s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.604s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534c43b6-b2bc-4fc9-b08d-5b49666f59f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1677336f-a33f-4341-b88e-ad8a931b29cb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609e804-d19b-4177-8477-85700fb90c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:49 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Volume volume-1677336f-a33f-4341-b88e-ad8a931b29cb (1677336f-a33f-4341-b88e-ad8a931b29cb): created successfully
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609e804-d19b-4177-8477-85700fb90c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (ce4d9c15-5232-40fe-9710-6a96edb05e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-729aac35-c0ea-4790-b068-7db0ece74c09 tempest-VolumesTestJSON-1569819612 None] Created volume successfully.
Sep 10 17:44:51 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (35153596-98e9-4069-ba16-1aebdde89e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e003ef-4c6c-4950-a336-d44767f0e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e003ef-4c6c-4950-a336-d44767f0e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1709639342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae04ee6-44e7-4dfd-a7d1-e503d205c145,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:51Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b88733e-8f13-4c88-ab9c-146ad0314627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b88733e-8f13-4c88-ab9c-146ad0314627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e7dd0f-7fb2-42cb-9898-61bc4add52cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e7dd0f-7fb2-42cb-9898-61bc4add52cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae04ee6-44e7-4dfd-a7d1-e503d205c145', 'volume_name': 'volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5249d92b-b353-449f-b473-86495f25d6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5249d92b-b353-449f-b473-86495f25d6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c3074-6f95-4b80-be3b-9d65ee924e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Volume 3ae04ee6-44e7-4dfd-a7d1-e503d205c145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145', 'volume_size': 1}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1709639342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae04ee6-44e7-4dfd-a7d1-e503d205c145,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71950a28fb6b4287ac52ed51e10b48bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:44:51Z,use_quota=True,user_id='41fec4eb5c0b4385a22c6c350a9384e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Creating volume 3ae04ee6-44e7-4dfd-a7d1-e503d205c145 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:44:51 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:44:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:51 devstack quobyte-client[82918]: System call of process 98477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:44:51 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=112, name=volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 1073741824" returned: 0 in 0.419s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" returned: 0 in 0.092s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c3074-6f95-4b80-be3b-9d65ee924e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee5ad2f-25e7-48c0-8e56-f1fa037d1a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:44:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Volume volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 (3ae04ee6-44e7-4dfd-a7d1-e503d205c145): created successfully
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee5ad2f-25e7-48c0-8e56-f1fa037d1a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:44:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Flow 'volume_create_manager' (35153596-98e9-4069-ba16-1aebdde89e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:44:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6cdc90fa-90e6-42c6-b070-6bf11b4b7353 tempest-VolumesTestJSON-1569819612 None] Created volume successfully.
Sep 10 17:44:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-3ae04ee6-44e7-4dfd-a7d1-e503d205c145-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-3ae04ee6-44e7-4dfd-a7d1-e503d205c145-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-quobyte-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" acquired by "delete_volume" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0b9bfa-af08-4a1c-9c44-5bec10db66ed]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" returned: 0 in 0.497s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-3ae04ee6-44e7-4dfd-a7d1-e503d205c145" released by "delete_volume" :: held 0.821s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Created reservations ['08cd0d7c-c0ee-4ff6-b0b4-54191f11ffb5', 'c99621ec-3260-45c6-b62c-0e222e121b1b', '8bd20534-67a4-4899-af51-6f3b5b3ffec0', 'de244759-2d1c-481a-a57b-38a3c6bd4677'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.105s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:56 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:56 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Deleted volume successfully.
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8989e64-096d-420c-82ee-79581d5bad14 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-3ae04ee6-44e7-4dfd-a7d1-e503d205c145-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-1677336f-a33f-4341-b88e-ad8a931b29cb-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "cinder-1677336f-a33f-4341-b88e-ad8a931b29cb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:57 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-quobyte-1677336f-a33f-4341-b88e-ad8a931b29cb" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-1677336f-a33f-4341-b88e-ad8a931b29cb" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27c219-1a21-4d7f-8fd6-c50ea31ca733]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb" returned: 0 in 0.524s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1677336f-a33f-4341-b88e-ad8a931b29cb" returned: 0 in 0.098s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-1677336f-a33f-4341-b88e-ad8a931b29cb" released by "delete_volume" :: held 0.793s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Created reservations ['9b8a5350-8ed6-45ea-9e83-c49c0b12c9b5', 'dae6c9ca-8034-46d6-bb5f-008307fe4be6', '03473d4c-fb34-44cf-a485-ab6c09b206c1', '1f8e2da6-4eed-40ee-bd56-29dfd18c5d0c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:44:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.093s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:44:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Deleted volume successfully.
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-8b6e955a-42d1-489e-a083-ec51aedf050e tempest-VolumesTestJSON-1569819612 None] Lock "cinder-1677336f-a33f-4341-b88e-ad8a931b29cb-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-6793a507-8ad3-4541-97ab-c4afa7b566bc-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-6793a507-8ad3-4541-97ab-c4afa7b566bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "cinder-quobyte-6793a507-8ad3-4541-97ab-c4afa7b566bc" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-6793a507-8ad3-4541-97ab-c4afa7b566bc" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b803a-3c29-4668-9a57-29999c4c10f6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:44:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc" returned: 0 in 0.463s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-6793a507-8ad3-4541-97ab-c4afa7b566bc" returned: 0 in 0.112s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-quobyte-6793a507-8ad3-4541-97ab-c4afa7b566bc" released by "delete_volume" :: held 0.790s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Created reservations ['8d68c9d1-b1cc-4dc0-9800-cc352ad1d8ca', '9e78d0c8-2ec7-48c5-b01a-d6e26c5462c4', '97c4da23-9828-490a-9551-4292e092fb8c', 'bf25657a-8560-475f-8a59-aa56c282d6cc'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:01 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Deleted volume successfully.
Sep 10 17:45:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-eb6a7cae-becf-4c4d-ba86-ae983a12c171 tempest-VolumesTestJSON-1569819612 None] Lock "cinder-6793a507-8ad3-4541-97ab-c4afa7b566bc-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.168s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:11 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=22,cinder:DELETE=2,cinder:SELECT=19,cinder:INSERT=10 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:45:11 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=30,cinder:UPDATE=56,cinder:DELETE=7,cinder:INSERT=5 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:45:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8066e484-101a-4bc4-a221-d0f8a0ab5d43 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8066e484-101a-4bc4-a221-d0f8a0ab5d43 tempest-GroupsTest-2067026783 None] Group tempest-Group1-1482335242: creating
Sep 10 17:45:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8066e484-101a-4bc4-a221-d0f8a0ab5d43 tempest-GroupsTest-2067026783 None] Group tempest-Group1-1482335242: created successfully
Sep 10 17:45:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8066e484-101a-4bc4-a221-d0f8a0ab5d43 tempest-GroupsTest-2067026783 None] Create group completed successfully.
Sep 10 17:45:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-78520a42-e085-40b0-93a4-0c47c4806de1 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-78520a42-e085-40b0-93a4-0c47c4806de1 tempest-GroupsTest-2067026783 None] Group tempest-Group2-1542943191: creating
Sep 10 17:45:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-78520a42-e085-40b0-93a4-0c47c4806de1 tempest-GroupsTest-2067026783 None] Group tempest-Group2-1542943191: created successfully
Sep 10 17:45:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-78520a42-e085-40b0-93a4-0c47c4806de1 tempest-GroupsTest-2067026783 None] Create group completed successfully.
Sep 10 17:45:17 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (c01dc9e4-8fd3-41c5-b502-7efe8b2dec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c130b858-c62f-4f8b-838b-2074f438bee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c130b858-c62f-4f8b-838b-2074f438bee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907427351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410c26ba-c01c-493e-a701-f75cfbb94d94,host='devstack@QuobyteHD#QuobyteHD',id=e9a529e1-698e-4f48-90e1-df0888f0f207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:17Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e17de20-6b5b-43a3-a91d-d4649e270f38),volume_type_id=4e17de20-6b5b-43a3-a91d-d4649e270f38)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f80fab-6268-4715-8356-63cccf7d808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f80fab-6268-4715-8356-63cccf7d808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb6cc78-451d-473c-8836-032c06433e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb6cc78-451d-473c-8836-032c06433e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a529e1-698e-4f48-90e1-df0888f0f207', 'volume_name': 'volume-e9a529e1-698e-4f48-90e1-df0888f0f207', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0295b720-78e4-4e8e-aabb-676244004e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0295b720-78e4-4e8e-aabb-676244004e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a8d2ce-2b57-44c4-a800-4e9158a070a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Volume e9a529e1-698e-4f48-90e1-df0888f0f207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a529e1-698e-4f48-90e1-df0888f0f207', 'volume_size': 1}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=410c26ba-c01c-493e-a701-f75cfbb94d94,created_at=2025-09-10T15:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907427351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=410c26ba-c01c-493e-a701-f75cfbb94d94,host='devstack@QuobyteHD#QuobyteHD',id=e9a529e1-698e-4f48-90e1-df0888f0f207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:17Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e17de20-6b5b-43a3-a91d-d4649e270f38),volume_type_id=4e17de20-6b5b-43a3-a91d-d4649e270f38)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Creating volume e9a529e1-698e-4f48-90e1-df0888f0f207 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:45:17 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:17 devstack quobyte-client[82918]: System call of process 98569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:45:17 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=113, name=volume-e9a529e1-698e-4f48-90e1-df0888f0f207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207 1073741824" returned: 0 in 0.438s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207" returned: 0 in 0.166s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] <== create_volume: return (666ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a8d2ce-2b57-44c4-a800-4e9158a070a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a529e1-698e-4f48-90e1-df0888f0f207', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df18af4-2372-4b00-b835-ede4aaa738af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:18 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Volume volume-e9a529e1-698e-4f48-90e1-df0888f0f207 (e9a529e1-698e-4f48-90e1-df0888f0f207): created successfully
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df18af4-2372-4b00-b835-ede4aaa738af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:18 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (c01dc9e4-8fd3-41c5-b502-7efe8b2dec41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8b819927-43ea-48c7-af40-8fca8102b6f3 tempest-GroupsTest-2067026783 None] Created volume successfully.
Sep 10 17:45:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Acquiring lock "cinder-quobyte-e9a529e1-698e-4f48-90e1-df0888f0f207" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-e9a529e1-698e-4f48-90e1-df0888f0f207" acquired by "delete_volume" :: waited 0.060s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f2846-7367-4ab3-9283-98ca6c66dd24]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207" returned: 0 in 0.515s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e9a529e1-698e-4f48-90e1-df0888f0f207" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-e9a529e1-698e-4f48-90e1-df0888f0f207" released by "delete_volume" :: held 0.806s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:21 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Created reservations ['011a59b5-a0ab-4f4f-9312-a6521eec9884'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:21 devstack cinder-volume[82884]: WARNING cinder.quota [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1469422844 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1469422844, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:45:21 devstack cinder-volume[82884]: WARNING cinder.quota [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1469422844 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1469422844, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:45:21 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Created reservations ['be819a3c-b91f-47cd-a018-9e4d1bfd5f38', 'b15b6d39-8e59-48ad-95fd-66467260e6cb', '5d35fa22-6f7e-4763-97c1-b1356f94d7d4', '3eabc3f4-c1d7-4be2-b170-4c63cea0b719'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.123s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c61d613e-e98b-4a3e-af48-c3730e0766bc tempest-GroupsTest-2067026783 None] Delete group completed successfully.
Sep 10 17:45:22 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Created reservations ['ccb82428-e199-4d2a-a21f-33002fe3da87'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.126s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:23 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-45428058-1c39-4826-970b-7e875322af0e tempest-GroupsTest-2067026783 None] Delete group completed successfully.
Sep 10 17:45:25 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2681f489-b5a0-4e02-b700-44d1f529eaf5 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2681f489-b5a0-4e02-b700-44d1f529eaf5 tempest-GroupsTest-2067026783 None] Group tempest-GroupsTest-Group-1310971451: creating
Sep 10 17:45:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2681f489-b5a0-4e02-b700-44d1f529eaf5 tempest-GroupsTest-2067026783 None] Group tempest-GroupsTest-Group-1310971451: created successfully
Sep 10 17:45:25 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2681f489-b5a0-4e02-b700-44d1f529eaf5 tempest-GroupsTest-2067026783 None] Create group completed successfully.
Sep 10 17:45:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (23b785e9-9176-49a5-8ed5-09338accf7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90c33e-235d-4b56-b62f-85d94cb9753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90c33e-235d-4b56-b62f-85d94cb9753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269158631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=13c693c2-6587-41ae-a578-a619dd3a1f64,host='devstack@QuobyteHD#QuobyteHD',id=40708c95-4877-4d07-b8a8-87296a57fc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:26Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f074143-2b1c-4743-9df4-3a6e1b63c847),volume_type_id=0f074143-2b1c-4743-9df4-3a6e1b63c847)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46cfeb7-e2b4-41e1-a7f5-89374468122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46cfeb7-e2b4-41e1-a7f5-89374468122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547fdb36-d922-4e07-9f82-9c18d0e48cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547fdb36-d922-4e07-9f82-9c18d0e48cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40708c95-4877-4d07-b8a8-87296a57fc28', 'volume_name': 'volume-40708c95-4877-4d07-b8a8-87296a57fc28', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3525fa-4126-41c5-8c9a-1de34df49184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3525fa-4126-41c5-8c9a-1de34df49184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34be58f3-c948-46aa-9973-15e295d594c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:26 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Volume 40708c95-4877-4d07-b8a8-87296a57fc28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40708c95-4877-4d07-b8a8-87296a57fc28', 'volume_size': 1}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=13c693c2-6587-41ae-a578-a619dd3a1f64,created_at=2025-09-10T15:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269158631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=13c693c2-6587-41ae-a578-a619dd3a1f64,host='devstack@QuobyteHD#QuobyteHD',id=40708c95-4877-4d07-b8a8-87296a57fc28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:26Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f074143-2b1c-4743-9df4-3a6e1b63c847),volume_type_id=0f074143-2b1c-4743-9df4-3a6e1b63c847)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Creating volume 40708c95-4877-4d07-b8a8-87296a57fc28 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:45:26 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:45:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:26 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=114, name=volume-40708c95-4877-4d07-b8a8-87296a57fc28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28 1073741824" returned: 0 in 0.371s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.564s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34be58f3-c948-46aa-9973-15e295d594c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40708c95-4877-4d07-b8a8-87296a57fc28', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39867302-f5d5-4751-b16a-e79c9a4ed17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:27 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Volume volume-40708c95-4877-4d07-b8a8-87296a57fc28 (40708c95-4877-4d07-b8a8-87296a57fc28): created successfully
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39867302-f5d5-4751-b16a-e79c9a4ed17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (23b785e9-9176-49a5-8ed5-09338accf7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-842bf687-518d-4c11-b6ca-d5ccab979797 tempest-GroupsTest-2067026783 None] Created volume successfully.
Sep 10 17:45:29 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (d1535bbd-b4b7-42db-a6c0-9c8beb3b0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f452a92-9a28-4b54-8d67-b8ac1f45dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f452a92-9a28-4b54-8d67-b8ac1f45dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1080401294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=13c693c2-6587-41ae-a578-a619dd3a1f64,host='devstack@QuobyteHD#QuobyteHD',id=ba2fa918-8a2f-4263-ac80-1fe08c8e140c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:29Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f074143-2b1c-4743-9df4-3a6e1b63c847),volume_type_id=0f074143-2b1c-4743-9df4-3a6e1b63c847)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd12ca8-0a59-4cbf-b03e-8cb4ad79405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd12ca8-0a59-4cbf-b03e-8cb4ad79405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e9fb22-61ca-439a-bc79-115b27dd01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e9fb22-61ca-439a-bc79-115b27dd01e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2fa918-8a2f-4263-ac80-1fe08c8e140c', 'volume_name': 'volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd16b8-3b20-4eba-8b63-1aea6a76d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55cd16b8-3b20-4eba-8b63-1aea6a76d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135e6af-1cf9-4402-ab16-6d7082674622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Volume ba2fa918-8a2f-4263-ac80-1fe08c8e140c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c', 'volume_size': 1}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=13c693c2-6587-41ae-a578-a619dd3a1f64,created_at=2025-09-10T15:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1080401294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=13c693c2-6587-41ae-a578-a619dd3a1f64,host='devstack@QuobyteHD#QuobyteHD',id=ba2fa918-8a2f-4263-ac80-1fe08c8e140c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e2dde7bd924b02ab1ad2019f39b654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:45:29Z,use_quota=True,user_id='0d2ac5228dc84e5792fd4c0f90b2d344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f074143-2b1c-4743-9df4-3a6e1b63c847),volume_type_id=0f074143-2b1c-4743-9df4-3a6e1b63c847)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Creating volume ba2fa918-8a2f-4263-ac80-1fe08c8e140c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:45:29 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:45:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:29 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=115, name=volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c 1073741824" returned: 0 in 0.596s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" returned: 0 in 0.216s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] <== create_volume: return (957ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135e6af-1cf9-4402-ab16-6d7082674622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6867be6f-b3a3-4ef5-bb30-ea87fae38a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:45:30 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Volume volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c (ba2fa918-8a2f-4263-ac80-1fe08c8e140c): created successfully
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6867be6f-b3a3-4ef5-bb30-ea87fae38a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:45:30 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Flow 'volume_create_manager' (d1535bbd-b4b7-42db-a6c0-9c8beb3b0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:45:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9a27127d-039e-4c16-893e-2cc190465fb6 tempest-GroupsTest-2067026783 None] Created volume successfully.
Sep 10 17:45:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3904dd87-82dd-467e-a893-723db169ee1f tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3904dd87-82dd-467e-a893-723db169ee1f tempest-GroupsTest-2067026783 None] Update group completed successfully.
Sep 10 17:45:33 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-243888e9-ed13-4a6a-90ea-0978ed7e3ea1 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-243888e9-ed13-4a6a-90ea-0978ed7e3ea1 tempest-GroupsTest-2067026783 None] Update group completed successfully.
Sep 10 17:45:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Acquiring lock "cinder-quobyte-40708c95-4877-4d07-b8a8-87296a57fc28" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:45:35 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-40708c95-4877-4d07-b8a8-87296a57fc28" acquired by "delete_volume" :: waited 0.077s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:45:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc832cae-2b63-4880-9240-3e607d5ddfb6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:45:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28" returned: 0 in 0.541s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-40708c95-4877-4d07-b8a8-87296a57fc28" returned: 0 in 0.097s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-40708c95-4877-4d07-b8a8-87296a57fc28" released by "delete_volume" :: held 0.858s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Acquiring lock "cinder-quobyte-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" acquired by "delete_volume" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baa43b2-1204-4d3b-ab2c-aa74497e0e43]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:45:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-9f41f2aa-668b-49d6-be79-83eaf62ae2fb tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-9f41f2aa-668b-49d6-be79-83eaf62ae2fb tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:37 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-9f41f2aa-668b-49d6-be79-83eaf62ae2fb tempest-TestShelveInstance-583346975 None] Terminate volume connection completed successfully.
Sep 10 17:45:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-9f41f2aa-668b-49d6-be79-83eaf62ae2fb tempest-TestShelveInstance-583346975 None] Deleting attachment 18dcb44c-118c-4e9a-ba2c-03a795e7d743. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:45:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" returned: 0 in 0.714s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" returned: 0 in 0.119s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "cinder-quobyte-ba2fa918-8a2f-4263-ac80-1fe08c8e140c" released by "delete_volume" :: held 1.020s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Acquiring lock "cinder-0d9d903f-ec83-4c07-b64c-38834e746067-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "cinder-0d9d903f-ec83-4c07-b64c-38834e746067-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:45:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Acquiring lock "cinder-quobyte-0d9d903f-ec83-4c07-b64c-38834e746067" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "cinder-quobyte-0d9d903f-ec83-4c07-b64c-38834e746067" acquired by "delete_volume" :: waited 0.037s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Created reservations ['dc75f054-e08f-428c-be52-5c680956756f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:38 devstack cinder-volume[82884]: WARNING cinder.quota [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1536192297 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1536192297, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:45:38 devstack cinder-volume[82884]: WARNING cinder.quota [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1536192297 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1536192297, it is now deprecated. Please use the default quota class for default quota.
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da837d-cfd9-4e09-bc22-144005eb8757]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Created reservations ['1e36357f-e02f-45da-8ea1-e253de3ed9a5', '2a6c9629-7b37-41d9-a99f-78291506114d', '73d1ddd9-1a32-4592-826b-02a8eb56036b', '6eb3672d-7008-45f3-9a12-152e26358a1f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.550s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 1 in 0.632s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Created reservations ['5fc35fed-bc24-40c8-ab51-cc675e804e4d', '18502f17-5574-432c-bf0c-17d82f67e19b', '4c9ddb21-3c09-4108-a299-6fd6560b7fcd', '1bab04c4-5b69-4739-a041-138c5a5a5d8b'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0d9d903f-ec83-4c07-b64c-38834e746067" returned: 0 in 0.283s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "cinder-quobyte-0d9d903f-ec83-4c07-b64c-38834e746067" released by "delete_volume" :: held 1.702s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.quota [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Created reservations ['ba403782-7349-4481-aa9e-c40b267ca91a', '02d495ff-30c9-4a47-a91b-d0702547e8f7', 'de302b02-ea7a-4053-bbfc-4df1f037923c', '943f10ac-3d7e-48d2-9f98-1822cdfbfec6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.416s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4c226424-2ae7-4bb1-a31b-e0f2e5aa88c1 tempest-GroupsTest-2067026783 None] Delete group completed successfully.
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.225s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:41 devstack cinder-volume[82884]: DEBUG cinder.manager [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Deleted volume successfully.
Sep 10 17:45:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [req-13fd2911-8ca3-48ea-8347-82c0e3c02421 req-300fb235-8b91-45f4-917e-78e05cf6c5b3 tempest-TestShelveInstance-583346975 None] Lock "cinder-0d9d903f-ec83-4c07-b64c-38834e746067-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:45:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-87bfd973-3464-4765-ab52-9eff61dc399f tempest-GroupsV320Test-1412943934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-87bfd973-3464-4765-ab52-9eff61dc399f tempest-GroupsV320Test-1412943934 None] Group tempest-GroupsV320Test-Group-1210071868: creating
Sep 10 17:45:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-87bfd973-3464-4765-ab52-9eff61dc399f tempest-GroupsV320Test-1412943934 None] Group tempest-GroupsV320Test-Group-1210071868: created successfully
Sep 10 17:45:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-87bfd973-3464-4765-ab52-9eff61dc399f tempest-GroupsV320Test-1412943934 None] Create group completed successfully.
Sep 10 17:45:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:45:50 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Created reservations ['e9308d93-6963-4393-ae95-d040b0cc77c8'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.155s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:45:51 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:45:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4b1b86ce-4de5-48b8-a2dc-d51c127a3c2d tempest-GroupsV320Test-1412943934 None] Delete group completed successfully.
Sep 10 17:46:00 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=56,cinder:UPDATE=62,cinder:INSERT=7,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:46:01 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=49,cinder:UPDATE=46,cinder:DELETE=2,cinder:INSERT=13 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:46:06 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Flow 'volume_create_manager' (df162db8-ca3c-4858-a969-56b80c02081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33cc9d7-f16a-4002-99f7-3d80eb4ea3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33cc9d7-f16a-4002-99f7-3d80eb4ea3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b61dd72-20c7-4a94-8b18-b9b4b26d158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1fa04a7bee4edc91c7fe4434757857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:06Z,use_quota=True,user_id='e24b43a0c7a4471d9bef60d9cdf08a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c85cf-76d7-47e7-99d9-f092c9ad1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c85cf-76d7-47e7-99d9-f092c9ad1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e2ff85-f9cc-4481-a716-d7d266ef4e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e2ff85-f9cc-4481-a716-d7d266ef4e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b61dd72-20c7-4a94-8b18-b9b4b26d158b', 'volume_name': 'volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8735084-4985-477b-98d4-c3fb938819ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8735084-4985-477b-98d4-c3fb938819ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b255440c-147c-4692-ab98-0ceb6bba67c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Volume 2b61dd72-20c7-4a94-8b18-b9b4b26d158b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b', 'volume_size': 1}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b61dd72-20c7-4a94-8b18-b9b4b26d158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1fa04a7bee4edc91c7fe4434757857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:06Z,use_quota=True,user_id='e24b43a0c7a4471d9bef60d9cdf08a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Creating volume 2b61dd72-20c7-4a94-8b18-b9b4b26d158b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:46:06 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:46:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=116, name=volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b 1073741824" returned: 0 in 0.422s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" returned: 0 in 0.132s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] <== create_volume: return (631ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b255440c-147c-4692-ab98-0ceb6bba67c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5705bc4-ba63-40bc-831e-a748b1aa3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Volume volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b (2b61dd72-20c7-4a94-8b18-b9b4b26d158b): created successfully
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5705bc4-ba63-40bc-831e-a748b1aa3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Flow 'volume_create_manager' (df162db8-ca3c-4858-a969-56b80c02081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-eb49c571-fca0-44d3-9d6f-81eddbeb66b4 tempest-CinderUnicodeTest-1952532742 None] Created volume successfully.
Sep 10 17:46:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Flow 'volume_create_manager' (b0e8ada0-fa02-4cc0-8e2e-eeb168646af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dede5f-17b6-41db-a31e-13cdc46aa2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dede5f-17b6-41db-a31e-13cdc46aa2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-400831047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2043ded5-aa36-40ca-bed7-84db11613e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1fa04a7bee4edc91c7fe4434757857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:09Z,use_quota=True,user_id='e24b43a0c7a4471d9bef60d9cdf08a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f14988-bf44-4d6f-a4e1-1733b7735486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f14988-bf44-4d6f-a4e1-1733b7735486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74835f8-9c98-41a0-8721-e9d467e45117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74835f8-9c98-41a0-8721-e9d467e45117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2043ded5-aa36-40ca-bed7-84db11613e17', 'volume_name': 'volume-2043ded5-aa36-40ca-bed7-84db11613e17', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c3a2d2-a9e0-49df-b2b5-612fa8f44b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c3a2d2-a9e0-49df-b2b5-612fa8f44b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c40fd86-c0f1-41e8-85d0-510273e9c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:09 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Volume 2043ded5-aa36-40ca-bed7-84db11613e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2043ded5-aa36-40ca-bed7-84db11613e17', 'volume_size': 1}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-400831047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2043ded5-aa36-40ca-bed7-84db11613e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1fa04a7bee4edc91c7fe4434757857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:09Z,use_quota=True,user_id='e24b43a0c7a4471d9bef60d9cdf08a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Creating volume 2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:46:09 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:46:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:10 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=117, name=volume-2043ded5-aa36-40ca-bed7-84db11613e17, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 1073741824" returned: 0 in 0.475s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17" returned: 0 in 0.142s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c40fd86-c0f1-41e8-85d0-510273e9c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2043ded5-aa36-40ca-bed7-84db11613e17', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074c8596-d2d6-4e79-97c8-1e27dc690d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:10 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Volume volume-2043ded5-aa36-40ca-bed7-84db11613e17 (2043ded5-aa36-40ca-bed7-84db11613e17): created successfully
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074c8596-d2d6-4e79-97c8-1e27dc690d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:10 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Flow 'volume_create_manager' (b0e8ada0-fa02-4cc0-8e2e-eeb168646af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-49be8202-1d28-495d-8401-b426b796b898 tempest-CinderUnicodeTest-1952532742 None] Created volume successfully.
Sep 10 17:46:12 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Creating offline snapshot bda1d5d4-088d-48c8-944b-3e2cbaf76d60 of volume 2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b98dbc1-bb54-46fe-a143-6da52fcf1489]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17" returned: 0 in 0.549s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:13 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=118, name=volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 1G" returned: 0 in 0.411s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2043ded5-aa36-40ca-bed7-84db11613e17 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:13 devstack quobyte-client[82918]: System call of process 98719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "qemu-img rebase -u -b volume-2043ded5-aa36-40ca-bed7-84db11613e17 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.265s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.096s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.info" returned: 0 in 0.118s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:46:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.info" returned: 0 in 0.103s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8dfcfeed-da99-46b9-ac12-71abfbc0e8a1 tempest-CinderUnicodeTest-1952532742 None] Create snapshot completed successfully
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-bda1d5d4-088d-48c8-944b-3e2cbaf76d60-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-bda1d5d4-088d-48c8-944b-3e2cbaf76d60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-quobyte-bda1d5d4-088d-48c8-944b-3e2cbaf76d60" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-bda1d5d4-088d-48c8-944b-3e2cbaf76d60" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Deleting offline snapshot bda1d5d4-088d-48c8-944b-3e2cbaf76d60 of volume 2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] snapshot_file for this snap is: volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf8d34a-2445-4701-b71b-f72ce63cb691]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:46:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.610s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2043ded5-aa36-40ca-bed7-84db11613e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50254cb-afe0-4d2d-99f6-82a478886ce6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17" returned: 0 in 0.438s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.232s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17.bda1d5d4-088d-48c8-944b-3e2cbaf76d60" returned: 0 in 0.101s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-bda1d5d4-088d-48c8-944b-3e2cbaf76d60" released by "_delete_snapshot" :: held 1.695s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" released by "delete_snapshot" :: held 1.727s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Created reservations ['62075879-0ff3-4333-8c22-d63286b2072f', '432a4ea0-5b72-485e-a733-e82ea1ad2b34', '46eb202a-7f81-4ec5-9c70-9a74f2974f82', 'fc428194-9200-4c4b-b284-c36b77182ef2'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:46:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Delete snapshot completed successfully.
Sep 10 17:46:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5daf58c9-7b17-4ed5-ab0e-38340f3c0bed tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-bda1d5d4-088d-48c8-944b-3e2cbaf76d60-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-2043ded5-aa36-40ca-bed7-84db11613e17-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-2043ded5-aa36-40ca-bed7-84db11613e17-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" acquired by "delete_volume" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4689fe-a860-4c4b-b023-152a4c720590]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:46:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17" returned: 0 in 0.440s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2043ded5-aa36-40ca-bed7-84db11613e17" returned: 0 in 0.139s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2043ded5-aa36-40ca-bed7-84db11613e17" released by "delete_volume" :: held 0.761s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Created reservations ['164afef0-1688-43f4-a283-0e98055b6b3d', '9ef4ec26-1251-478f-9dbe-f388de4414c9', 'f208c8ab-cc3f-48e9-b715-a98db1830546', '8a6a58fe-482d-42f4-9f82-2dfe67e46f7e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:46:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Deleted volume successfully.
Sep 10 17:46:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7187780e-11b2-4071-943e-1fead6678704 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-2043ded5-aa36-40ca-bed7-84db11613e17-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-2b61dd72-20c7-4a94-8b18-b9b4b26d158b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-2b61dd72-20c7-4a94-8b18-b9b4b26d158b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "cinder-quobyte-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6504481-f2a9-47ad-98c4-059fee95751d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:46:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" returned: 0 in 0.560s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" returned: 0 in 0.125s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-quobyte-2b61dd72-20c7-4a94-8b18-b9b4b26d158b" released by "delete_volume" :: held 0.901s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Created reservations ['f208ebbb-a4f2-4fa0-9f4e-b843f1b47682', '2ded53e4-ff0f-41ab-beb0-a109e64e49ae', '8fea72bf-b5e6-4ae2-a939-b7e3dd77f640', '6c190af3-f0e7-4518-93a6-d36819e83c6e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.176s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:46:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Deleted volume successfully.
Sep 10 17:46:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-bfbc947b-af5c-4a92-b182-69084b33caa0 tempest-CinderUnicodeTest-1952532742 None] Lock "cinder-2b61dd72-20c7-4a94-8b18-b9b4b26d158b-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:46:32 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=36,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:46:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:46:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:DELETE=4,cinder:INSERT=8 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:46:56 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Flow 'volume_create_manager' (fbf2f463-c86f-498a-9442-3e2a6f69f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b84480-efd1-4ae5-9b6b-4baa4e8b1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b84480-efd1-4ae5-9b6b-4baa4e8b1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1341586327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8af30a1-1c84-4e36-8104-1967cb22a7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd95fdd37fe447e08b64973a21f664c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:57Z,use_quota=True,user_id='4ab6c54bd8e64d7d8d8809e4500b195a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5069fe4-546c-4bd5-b9e8-a7f57113f5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5069fe4-546c-4bd5-b9e8-a7f57113f5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb9182-9571-4a5e-91f9-6d39e1c42abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb9182-9571-4a5e-91f9-6d39e1c42abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8af30a1-1c84-4e36-8104-1967cb22a7cb', 'volume_name': 'volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:56 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ded83-8c8f-4f88-8302-0c92960a4663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ded83-8c8f-4f88-8302-0c92960a4663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711a18f1-c195-4d2b-b46a-fd27928b98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Volume e8af30a1-1c84-4e36-8104-1967cb22a7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb', 'volume_size': 1}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1341586327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8af30a1-1c84-4e36-8104-1967cb22a7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd95fdd37fe447e08b64973a21f664c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:57Z,use_quota=True,user_id='4ab6c54bd8e64d7d8d8809e4500b195a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Creating volume e8af30a1-1c84-4e36-8104-1967cb22a7cb {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:46:57 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:57 devstack quobyte-client[82918]: System call of process 98753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:46:57 devstack quobyte-client[82918]: System call of process 98753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:46:57 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=120, name=volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb 1073741824" returned: 0 in 0.473s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb" returned: 0 in 0.119s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] <== create_volume: return (685ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711a18f1-c195-4d2b-b46a-fd27928b98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef8d5cf-d821-49c7-a276-16036a03ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Volume volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb (e8af30a1-1c84-4e36-8104-1967cb22a7cb): created successfully
Sep 10 17:46:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef8d5cf-d821-49c7-a276-16036a03ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Flow 'volume_create_manager' (fbf2f463-c86f-498a-9442-3e2a6f69f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:58 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-27e27c1b-5bcf-48eb-aed2-bf2e839344a4 tempest-VolumesMetadataTest-909282317 None] Created volume successfully.
Sep 10 17:46:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Flow 'volume_create_manager' (1cdac130-61d1-4711-aa81-ba6aaed42858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3650310-a19b-4b6f-b79b-cb842b41f75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3650310-a19b-4b6f-b79b-cb842b41f75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-875980221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9578e41d-679f-420b-8927-3f7c0a4939cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bc8d30d6e24b79a79d9c9f82935b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:59Z,use_quota=True,user_id='aea6f664f20d4cd389d764e906aee5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95b6c16-d6f1-499b-b84a-7669c25c7d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95b6c16-d6f1-499b-b84a-7669c25c7d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c47028f-88ec-4c7c-b670-09c8a8b7cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c47028f-88ec-4c7c-b670-09c8a8b7cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9578e41d-679f-420b-8927-3f7c0a4939cd', 'volume_name': 'volume-9578e41d-679f-420b-8927-3f7c0a4939cd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf9b11-698f-42d1-8e60-9bbfd76ea079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffaf9b11-698f-42d1-8e60-9bbfd76ea079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e5dc77-2f07-4f7e-86bb-8b5e1dc8c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:46:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Volume 9578e41d-679f-420b-8927-3f7c0a4939cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9578e41d-679f-420b-8927-3f7c0a4939cd', 'volume_size': 1}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-875980221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9578e41d-679f-420b-8927-3f7c0a4939cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bc8d30d6e24b79a79d9c9f82935b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:46:59Z,use_quota=True,user_id='aea6f664f20d4cd389d764e906aee5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Creating volume 9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:46:59 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:46:59 devstack quobyte-client[82918]: System call of process 98758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:46:59 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=121, name=volume-9578e41d-679f-420b-8927-3f7c0a4939cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd 1073741824" returned: 0 in 0.388s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:46:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.176s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] <== create_volume: return (690ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Acquiring lock "cinder-e8af30a1-1c84-4e36-8104-1967cb22a7cb-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e5dc77-2f07-4f7e-86bb-8b5e1dc8c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9578e41d-679f-420b-8927-3f7c0a4939cd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb260fb-4d7e-4836-beaf-01c4dab85153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "cinder-e8af30a1-1c84-4e36-8104-1967cb22a7cb-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Volume volume-9578e41d-679f-420b-8927-3f7c0a4939cd (9578e41d-679f-420b-8927-3f7c0a4939cd): created successfully
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb260fb-4d7e-4836-beaf-01c4dab85153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Flow 'volume_create_manager' (1cdac130-61d1-4711-aa81-ba6aaed42858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d324643b-ea0a-474f-bf42-98ac82bc0bfa tempest-SnapshotDependencyTests-1053228696 None] Created volume successfully.
Sep 10 17:47:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Acquiring lock "cinder-quobyte-e8af30a1-1c84-4e36-8104-1967cb22a7cb" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "cinder-quobyte-e8af30a1-1c84-4e36-8104-1967cb22a7cb" acquired by "delete_volume" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b948685d-0e98-495d-96fc-b6b2876de69f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb" returned: 0 in 0.421s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e8af30a1-1c84-4e36-8104-1967cb22a7cb" returned: 0 in 0.087s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "cinder-quobyte-e8af30a1-1c84-4e36-8104-1967cb22a7cb" released by "delete_volume" :: held 0.671s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Created reservations ['d61ae1d2-dc88-4cb2-bb73-9c70adf13914', '8d0ed1b6-e64a-495b-bfba-a347caff8a6f', 'ce470f18-3691-477c-8f82-c06b15c07a02', '153d3e41-df13-4464-8136-7d2f39dd9639'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:01 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Deleted volume successfully.
Sep 10 17:47:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Creating offline snapshot 95d04f30-8e9b-41e0-8d06-49ebdfce4c7e of volume 9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-1e176ebd-df34-4ad2-9221-89b4db609971 tempest-VolumesMetadataTest-909282317 None] Lock "cinder-e8af30a1-1c84-4e36-8104-1967cb22a7cb-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b96d7-558d-473f-9900-6d56e10fa977]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.477s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:02 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=122, name=volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e 1G" returned: 0 in 0.289s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9578e41d-679f-420b-8927-3f7c0a4939cd -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.238s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:03 devstack quobyte-client[82918]: System call of process 98775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "qemu-img rebase -u -b volume-9578e41d-679f-420b-8927-3f7c0a4939cd -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.310s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.134s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.128s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.info" returned: 0 in 0.111s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:47:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.info" returned: 0 in 0.093s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6191ba58-ca5e-43f6-a4f0-835946b485eb tempest-SnapshotDependencyTests-1053228696 None] Create snapshot completed successfully
Sep 10 17:47:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:05 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Flow 'volume_create_manager' (33b0b102-1581-461f-bbb4-a4fc004f1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f066caf8-b6f9-4779-bb8e-362ef0b8f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f066caf8-b6f9-4779-bb8e-362ef0b8f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d60281e-e958-45c8-9b1a-6cfbbed13d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bc8d30d6e24b79a79d9c9f82935b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95d04f30-8e9b-41e0-8d06-49ebdfce4c7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:06Z,use_quota=True,user_id='aea6f664f20d4cd389d764e906aee5e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd39079-eab3-48f9-b96f-23881301770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd39079-eab3-48f9-b96f-23881301770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67560ace-4c0b-45d4-9da7-d9d8194b24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67560ace-4c0b-45d4-9da7-d9d8194b24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d60281e-e958-45c8-9b1a-6cfbbed13d88', 'volume_name': 'volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88', 'volume_size': 1, 'snapshot_id': '95d04f30-8e9b-41e0-8d06-49ebdfce4c7e'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438b3fac-6a6f-40e6-8eb2-87f018725f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438b3fac-6a6f-40e6-8eb2-87f018725f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898175b3-f74a-44ba-9aa7-d2f311babe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Volume 7d60281e-e958-45c8-9b1a-6cfbbed13d88: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88', 'volume_size': 1, 'snapshot_id': '95d04f30-8e9b-41e0-8d06-49ebdfce4c7e'}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-7d60281e-e958-45c8-9b1a-6cfbbed13d88" by "_create_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-7d60281e-e958-45c8-9b1a-6cfbbed13d88" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Creating volume 7d60281e-e958-45c8-9b1a-6cfbbed13d88 from snapshot 95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" by "_copy_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] snapshot: 95d04f30-8e9b-41e0-8d06-49ebdfce4c7e, volume: 7d60281e-e958-45c8-9b1a-6cfbbed13d88,  {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5638bca-fae2-4f76-9724-55054be0105a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.459s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9578e41d-679f-420b-8927-3f7c0a4939cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Creating direct copy from snapshot {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[128007c0-d75b-4e44-9c4c-4cb9dabe0cb9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:07 devstack quobyte-client[82918]: System call of process 98791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:47:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.459s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:07 devstack cinder-volume[82884]: DEBUG cinder.utils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 not found in is_blk_device check {{(pid=82884) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 17:47:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=124, name=volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:11 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Flow 'volume_create_manager' (a4ccb236-e48b-45cb-af9f-dbb557c14e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc0e53e-fb7b-401b-ae1d-8a47a2d085b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc0e53e-fb7b-401b-ae1d-8a47a2d085b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-315256311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fff675-80a6-4919-ba26-c1b995b677a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aafa38f6d54c2b917114e907b328b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:11Z,use_quota=True,user_id='7f3a43be73654eeeb98a0d26b6311043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03822905-3252-4d8f-85f1-34e9a1dfe60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03822905-3252-4d8f-85f1-34e9a1dfe60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d63e48-5e03-4c82-91ad-83a529eb08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d63e48-5e03-4c82-91ad-83a529eb08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fff675-80a6-4919-ba26-c1b995b677a8', 'volume_name': 'volume-b9fff675-80a6-4919-ba26-c1b995b677a8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e04a9ca-d41b-4cda-9351-de83051f1a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e04a9ca-d41b-4cda-9351-de83051f1a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db15c4c-86c5-424b-bca9-451b7bf4d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:12 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Volume b9fff675-80a6-4919-ba26-c1b995b677a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fff675-80a6-4919-ba26-c1b995b677a8', 'volume_size': 1}
Sep 10 17:47:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88" returned: 0 in 8.178s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e35e9a-bd44-4346-8358-b088c7b59b57]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.536s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:47:16 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Converted 1024.00 MB image at 125.05 MB/s
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88" returned: 0 in 0.097s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" released by "_copy_volume_from_snapshot" :: held 10.117s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-7d60281e-e958-45c8-9b1a-6cfbbed13d88" released by "_create_volume_from_snapshot" :: held 10.162s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.188s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.733s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-315256311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fff675-80a6-4919-ba26-c1b995b677a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aafa38f6d54c2b917114e907b328b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:11Z,use_quota=True,user_id='7f3a43be73654eeeb98a0d26b6311043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Creating volume b9fff675-80a6-4919-ba26-c1b995b677a8 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:47:16 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:16 devstack quobyte-client[82918]: System call of process 98841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:47:16 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=125, name=volume-b9fff675-80a6-4919-ba26-c1b995b677a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898175b3-f74a-44ba-9aa7-d2f311babe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88', 'volume_size': 1, 'snapshot_id': '95d04f30-8e9b-41e0-8d06-49ebdfce4c7e'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:16 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f116aa9c-432b-4a9b-b535-056d9c7682ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Volume volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 (7d60281e-e958-45c8-9b1a-6cfbbed13d88): created successfully
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f116aa9c-432b-4a9b-b535-056d9c7682ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Flow 'volume_create_manager' (33b0b102-1581-461f-bbb4-a4fc004f1dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8 1073741824" returned: 0 in 0.491s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8" returned: 0 in 0.244s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b52fc9a0-e833-4577-9641-8425dc3a0cd8 tempest-SnapshotDependencyTests-1053228696 None] Created volume successfully.
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db15c4c-86c5-424b-bca9-451b7bf4d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fff675-80a6-4919-ba26-c1b995b677a8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d9e8a-e479-42b1-ba57-b8b5a408434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:17 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Volume volume-b9fff675-80a6-4919-ba26-c1b995b677a8 (b9fff675-80a6-4919-ba26-c1b995b677a8): created successfully
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d9e8a-e479-42b1-ba57-b8b5a408434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:17 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Flow 'volume_create_manager' (a4ccb236-e48b-45cb-af9f-dbb557c14e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4c656f14-0f4f-4d1b-b0b0-1a044676ab71 tempest-VolumesTransfersTest-317420958 None] Created volume successfully.
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Deleting offline snapshot 95d04f30-8e9b-41e0-8d06-49ebdfce4c7e of volume 9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] snapshot_file for this snap is: volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2caba-f0d4-4fbc-a9ae-c3097734fa66]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.495s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9578e41d-679f-420b-8927-3f7c0a4939cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba4894e-e278-4759-837d-d125e91641b6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.492s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-390e35aa-38a6-4471-8022-4981955c503a tempest-VolumesTransfersTest-521258523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.458s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-390e35aa-38a6-4471-8022-4981955c503a tempest-VolumesTransfersTest-521258523 None] Transfer volume completed successfully.
Sep 10 17:47:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd.95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" returned: 0 in 0.593s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e" released by "_delete_snapshot" :: held 2.279s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" released by "delete_snapshot" :: held 2.299s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:20 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Created reservations ['9618b0a2-65c8-4972-b0bb-52160daadd59', '245e5022-3684-43a4-aa56-d825e2bffc9f', 'a2adb578-34d6-4723-a560-436084b82bce', 'cac79aaf-96ec-41aa-8680-4eac3ca2f5fd'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:21 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Delete snapshot completed successfully.
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-2889f3e3-8a4a-4912-8166-71e2fc52e5bd tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-95d04f30-8e9b-41e0-8d06-49ebdfce4c7e-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "cinder-b9fff675-80a6-4919-ba26-c1b995b677a8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-b9fff675-80a6-4919-ba26-c1b995b677a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "cinder-quobyte-b9fff675-80a6-4919-ba26-c1b995b677a8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-9578e41d-679f-420b-8927-3f7c0a4939cd-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-quobyte-b9fff675-80a6-4919-ba26-c1b995b677a8" acquired by "delete_volume" :: waited 0.045s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-9578e41d-679f-420b-8927-3f7c0a4939cd-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea86ee1a-0f93-4b15-b31f-78e46fb97712]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:22 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" acquired by "delete_volume" :: waited 0.062s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[087af51f-9a39-4928-8daf-df4cbba5969f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8" returned: 0 in 0.636s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b9fff675-80a6-4919-ba26-c1b995b677a8" returned: 0 in 0.160s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-quobyte-b9fff675-80a6-4919-ba26-c1b995b677a8" released by "delete_volume" :: held 1.069s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:22 devstack quobyte-client[82918]: System call of process 98861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.742s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-9578e41d-679f-420b-8927-3f7c0a4939cd" returned: 0 in 0.292s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Created reservations ['e3d615aa-7fb0-42da-ac86-dd8465d4a263', '95c1c4d5-0dc7-4759-8933-e00aa6facc2f', '1ce16c94-7cd1-4225-a39b-d1dcb7478861', 'ea156b78-7b1f-4942-b970-45c5873bb21a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-9578e41d-679f-420b-8927-3f7c0a4939cd" released by "delete_volume" :: held 1.196s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Created reservations ['64e41180-2686-4ac5-90e5-0cf7a2ca06fb', '583ce5a2-8707-4ba5-8390-ea94466ecc17', '7dfef4c4-46ce-4396-bca2-8938d90b5a8b', '1a757a9f-1bab-4ca5-a7ff-03ee11353139'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.384s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-7d60281e-e958-45c8-9b1a-6cfbbed13d88-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:24 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Deleted volume successfully.
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.575s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:24 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Deleted volume successfully.
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-7d60281e-e958-45c8-9b1a-6cfbbed13d88-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d5fe65bb-bd9f-4f31-b998-e1c2d3c3ad24 tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-b9fff675-80a6-4919-ba26-c1b995b677a8-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-41726a19-ba23-4089-ac1c-459d199ce33d tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-9578e41d-679f-420b-8927-3f7c0a4939cd-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:24 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e88658-94c1-4b28-89e0-7ee0cd08288a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:24 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:24 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Flow 'volume_create_manager' (3ffa2b95-840d-4e76-8b89-60d984d316e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7249dc8e-ecbf-46cc-99e5-009be888ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7249dc8e-ecbf-46cc-99e5-009be888ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1261179315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aafa38f6d54c2b917114e907b328b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:25Z,use_quota=True,user_id='7f3a43be73654eeeb98a0d26b6311043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c307080-d190-4816-9ec2-08f2ae650547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c307080-d190-4816-9ec2-08f2ae650547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ece37df-8eef-44e3-9755-5a6157c8ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ece37df-8eef-44e3-9755-5a6157c8ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e', 'volume_name': 'volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bff94-f24b-49c8-ace9-58dfd810ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45bff94-f24b-49c8-ace9-58dfd810ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7f8c66-ff71-4738-9c6a-82685fcce12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:25 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Volume 7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e', 'volume_size': 1}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1261179315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46aafa38f6d54c2b917114e907b328b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:25Z,use_quota=True,user_id='7f3a43be73654eeeb98a0d26b6311043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Creating volume 7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:47:25 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:25 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=126, name=volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88" returned: 0 in 0.714s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7d60281e-e958-45c8-9b1a-6cfbbed13d88" returned: 0 in 0.160s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e 1073741824" returned: 0 in 0.444s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-quobyte-7d60281e-e958-45c8-9b1a-6cfbbed13d88" released by "delete_volume" :: held 1.208s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" returned: 0 in 0.385s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] <== create_volume: return (860ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7f8c66-ff71-4738-9c6a-82685fcce12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072560de-7237-4ef1-b752-32f6bc2279fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:26 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Volume volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e (7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e): created successfully
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072560de-7237-4ef1-b752-32f6bc2279fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Flow 'volume_create_manager' (3ffa2b95-840d-4e76-8b89-60d984d316e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Created reservations ['e811be0b-9a11-4a03-9851-3f8f26624fd6', '1f5398ef-72dc-45a3-a7c2-47dee72aa85e', '42594602-9f77-4441-a2dd-a93ac53783a8', '2281f21c-2830-43ec-80ad-bec073cdb4e0'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2754b48a-efaa-499a-be7c-4f7abfb1be0c tempest-VolumesTransfersTest-317420958 None] Created volume successfully.
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.102s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Deleted volume successfully.
Sep 10 17:47:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e78319a5-6ffe-467c-bfd6-11b0f8104e65 tempest-SnapshotDependencyTests-1053228696 None] Lock "cinder-7d60281e-e958-45c8-9b1a-6cfbbed13d88-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "cinder-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "cinder-quobyte-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-quobyte-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" acquired by "delete_volume" :: waited 0.029s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43a1c48-7815-4eee-bcf2-9f32e4e4179f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" returned: 0 in 0.524s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" returned: 0 in 0.109s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-quobyte-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e" released by "delete_volume" :: held 0.831s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:28 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Created reservations ['cbdc09b7-8c6f-40ec-a47f-c44933ed320b', 'e1635b71-b509-43b9-a5d9-2354468c05b4', 'f15214d4-a2d7-4a5b-9553-45305df2aa36', '219f9c3d-7357-41b6-b715-753741960af0'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.108s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:29 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Deleted volume successfully.
Sep 10 17:47:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-23f317bb-ded3-4d78-90fd-02fb2016392d tempest-VolumesTransfersTest-1859917303 None] Lock "cinder-7f7ef21e-aac0-46d6-8e4a-95a6cbd6083e-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:39 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=37,cinder:UPDATE=53,cinder:INSERT=16,cinder:DELETE=3 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:47:39 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=60,cinder:SELECT=39,cinder:DELETE=8,cinder:INSERT=8 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:47:42 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Flow 'volume_create_manager' (2bc6193d-2afc-490a-ab0e-7b414f70c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf3170-7f83-40a8-9eff-b6b651c8d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf3170-7f83-40a8-9eff-b6b651c8d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-703712635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe657b-35ca-4421-a2fa-ef5f390960e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bb8f4406848bba72778f19572426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:42Z,use_quota=True,user_id='54de309f21ce492d8ccf639190e80afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d861cd2c-73f3-4ec5-a329-90549e59519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d861cd2c-73f3-4ec5-a329-90549e59519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe7bbc5-414c-4cd3-bae5-105ac94a9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe7bbc5-414c-4cd3-bae5-105ac94a9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fe657b-35ca-4421-a2fa-ef5f390960e8', 'volume_name': 'volume-42fe657b-35ca-4421-a2fa-ef5f390960e8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb08dc-87e5-4915-8ffb-3382a8688ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb08dc-87e5-4915-8ffb-3382a8688ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce39c4c-6b32-479d-a1da-a0dfedad66e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:42 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Volume 42fe657b-35ca-4421-a2fa-ef5f390960e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fe657b-35ca-4421-a2fa-ef5f390960e8', 'volume_size': 1}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-703712635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42fe657b-35ca-4421-a2fa-ef5f390960e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bb8f4406848bba72778f19572426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:42Z,use_quota=True,user_id='54de309f21ce492d8ccf639190e80afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Creating volume 42fe657b-35ca-4421-a2fa-ef5f390960e8 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:47:42 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:47:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:42 devstack quobyte-client[82918]: System call of process 98890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:47:42 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=127, name=volume-42fe657b-35ca-4421-a2fa-ef5f390960e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 1073741824" returned: 0 in 0.674s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8" returned: 0 in 0.136s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] <== create_volume: return (952ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:47:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce39c4c-6b32-479d-a1da-a0dfedad66e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fe657b-35ca-4421-a2fa-ef5f390960e8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0717f967-6efc-4b30-99a8-4a1d284fcd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:44 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Volume volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 (42fe657b-35ca-4421-a2fa-ef5f390960e8): created successfully
Sep 10 17:47:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0717f967-6efc-4b30-99a8-4a1d284fcd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Flow 'volume_create_manager' (2bc6193d-2afc-490a-ab0e-7b414f70c410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:44 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b5d7b4f3-9dca-4cbc-8f35-a4c4656fe04d tempest-VolumesTransfersV355Test-1355119610 None] Created volume successfully.
Sep 10 17:47:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-caf04cea-f13a-4f36-8884-5ed3bfb1869f tempest-VolumesTransfersV355Test-751787661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-caf04cea-f13a-4f36-8884-5ed3bfb1869f tempest-VolumesTransfersV355Test-751787661 None] Transfer volume completed successfully.
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "cinder-42fe657b-35ca-4421-a2fa-ef5f390960e8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-42fe657b-35ca-4421-a2fa-ef5f390960e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:47 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "cinder-quobyte-42fe657b-35ca-4421-a2fa-ef5f390960e8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-quobyte-42fe657b-35ca-4421-a2fa-ef5f390960e8" acquired by "delete_volume" :: waited 0.011s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb916a-6be5-4d96-bb42-a24652681e4d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8" returned: 0 in 0.406s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-42fe657b-35ca-4421-a2fa-ef5f390960e8" returned: 0 in 0.111s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-quobyte-42fe657b-35ca-4421-a2fa-ef5f390960e8" released by "delete_volume" :: held 0.668s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Created reservations ['be8383ad-831a-4076-95bd-4f6400e6643e', '30bd5366-79fa-4796-b089-004ca36a6115', '0a092cab-a242-446c-9e6b-907e8cef638d', 'f9642421-dfdd-4a20-b420-94349c727bcc'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.229s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:48 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:48 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Deleted volume successfully.
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3152dbce-3069-4892-971f-71c103ff8e0a tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-42fe657b-35ca-4421-a2fa-ef5f390960e8-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:49 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Flow 'volume_create_manager' (840e04c8-4ba9-45b2-8803-505179ce95bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6846a764-85a1-4b81-bacc-fe537de81073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6846a764-85a1-4b81-bacc-fe537de81073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667539749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc3de6-7369-495c-89cd-5312aac35016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bb8f4406848bba72778f19572426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:49Z,use_quota=True,user_id='54de309f21ce492d8ccf639190e80afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae72d21c-5b5f-48d6-8795-0a32c115dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae72d21c-5b5f-48d6-8795-0a32c115dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa476c55-bece-4a4a-8164-733cc6b72e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa476c55-bece-4a4a-8164-733cc6b72e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bc3de6-7369-495c-89cd-5312aac35016', 'volume_name': 'volume-e0bc3de6-7369-495c-89cd-5312aac35016', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adbbd73-8910-498b-a77d-21e178c01463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adbbd73-8910-498b-a77d-21e178c01463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ede68f-b6ce-48e2-b62c-c319a46c21ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:49 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Volume e0bc3de6-7369-495c-89cd-5312aac35016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bc3de6-7369-495c-89cd-5312aac35016', 'volume_size': 1}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1667539749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bc3de6-7369-495c-89cd-5312aac35016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735bb8f4406848bba72778f19572426c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:47:49Z,use_quota=True,user_id='54de309f21ce492d8ccf639190e80afb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Creating volume e0bc3de6-7369-495c-89cd-5312aac35016 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:47:49 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:49 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=128, name=volume-e0bc3de6-7369-495c-89cd-5312aac35016, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016 1073741824" returned: 0 in 0.389s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016" returned: 0 in 0.084s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.557s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ede68f-b6ce-48e2-b62c-c319a46c21ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bc3de6-7369-495c-89cd-5312aac35016', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f3300-de0d-49a4-934f-5cba33bc17ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:47:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Volume volume-e0bc3de6-7369-495c-89cd-5312aac35016 (e0bc3de6-7369-495c-89cd-5312aac35016): created successfully
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f3300-de0d-49a4-934f-5cba33bc17ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:47:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Flow 'volume_create_manager' (840e04c8-4ba9-45b2-8803-505179ce95bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:47:50 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bbe876af-84b8-4388-8eaa-55cc28ba8ac1 tempest-VolumesTransfersV355Test-1355119610 None] Created volume successfully.
Sep 10 17:47:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "cinder-e0bc3de6-7369-495c-89cd-5312aac35016-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-e0bc3de6-7369-495c-89cd-5312aac35016-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "cinder-quobyte-e0bc3de6-7369-495c-89cd-5312aac35016" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-quobyte-e0bc3de6-7369-495c-89cd-5312aac35016" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562b858-5e88-44f4-b001-3c9da31eb824]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016" returned: 0 in 0.423s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-e0bc3de6-7369-495c-89cd-5312aac35016" returned: 0 in 0.107s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-quobyte-e0bc3de6-7369-495c-89cd-5312aac35016" released by "delete_volume" :: held 0.679s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Created reservations ['20c49915-0e66-49e2-acb0-e16b98638c58', 'be8b3d51-7884-42e8-86f9-341ceaa6e909', 'cc9f6e10-fc48-4a23-a36c-294320e47b01', 'c38dae72-8332-49f8-b504-ff80708b1b4f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.103s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:47:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Deleted volume successfully.
Sep 10 17:47:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab14bc54-7c29-4356-aa89-b142a6c28eb5 tempest-VolumesTransfersV355Test-323869365 None] Lock "cinder-e0bc3de6-7369-495c-89cd-5312aac35016-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:01 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Flow 'volume_create_manager' (06e37423-4d68-45c5-b4ec-718ef9700bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1474e4f4-689c-42af-b4d2-fdd31778f4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1474e4f4-689c-42af-b4d2-fdd31778f4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1071170976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c7abf5-90c0-40a5-a274-eae5a6c6a48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccc3f7588de4eebb53d0455f87e1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:02Z,use_quota=True,user_id='6a48c21403f84ccbbf4ada6c2fe2492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da16b84f-552f-49db-ba06-933b368e9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da16b84f-552f-49db-ba06-933b368e9e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6740186e-6ae9-47b3-9564-52bbc4027f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6740186e-6ae9-47b3-9564-52bbc4027f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c7abf5-90c0-40a5-a274-eae5a6c6a48c', 'volume_name': 'volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b5aa62-fc85-4f93-89a7-7e061ff967c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b5aa62-fc85-4f93-89a7-7e061ff967c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474f595b-1e48-419d-bc3c-35fafccc20e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:01 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Volume 38c7abf5-90c0-40a5-a274-eae5a6c6a48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c', 'volume_size': 1}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1071170976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c7abf5-90c0-40a5-a274-eae5a6c6a48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccc3f7588de4eebb53d0455f87e1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:02Z,use_quota=True,user_id='6a48c21403f84ccbbf4ada6c2fe2492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Creating volume 38c7abf5-90c0-40a5-a274-eae5a6c6a48c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:01 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:02 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=129, name=volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c 1073741824" returned: 0 in 0.329s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" returned: 0 in 0.085s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.496s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474f595b-1e48-419d-bc3c-35fafccc20e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f995f0-99fb-4a68-a732-246d0c6b8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Volume volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c (38c7abf5-90c0-40a5-a274-eae5a6c6a48c): created successfully
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3f995f0-99fb-4a68-a732-246d0c6b8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Flow 'volume_create_manager' (06e37423-4d68-45c5-b4ec-718ef9700bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:02 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-26326877-3b00-4c3b-b7eb-5991b9f72a8a tempest-VolumesTransfersV357Test-424308472 None] Created volume successfully.
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.096s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-edb6dae6-fb64-44ca-9bbe-5f7010662b76 tempest-VolumesTransfersV357Test-283224931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-edb6dae6-fb64-44ca-9bbe-5f7010662b76 tempest-VolumesTransfersV357Test-283224931 None] Transfer volume completed successfully.
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "cinder-38c7abf5-90c0-40a5-a274-eae5a6c6a48c-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-38c7abf5-90c0-40a5-a274-eae5a6c6a48c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "cinder-quobyte-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-quobyte-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c3030-76e6-4bd9-b072-b7bddfb4ddc6]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" returned: 0 in 0.415s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" returned: 0 in 0.111s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-quobyte-38c7abf5-90c0-40a5-a274-eae5a6c6a48c" released by "delete_volume" :: held 0.674s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Created reservations ['f883af99-ac87-44ed-9c0b-70ef4cd169b9', '12289008-8945-4f06-96e8-ec4ab82e0b65', 'f6420c18-e0ab-4eac-93c7-8259d333af34', 'c8511790-7169-4229-86ba-c7dea663d29a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.110s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:06 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Deleted volume successfully.
Sep 10 17:48:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e5691ba8-4a8a-47c8-80d2-5bdbf0786f90 tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-38c7abf5-90c0-40a5-a274-eae5a6c6a48c-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:08 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Flow 'volume_create_manager' (dacea7e7-a399-4f3d-9372-97bb2e9c65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dae0e4-43a8-4815-b690-ad78f083be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dae0e4-43a8-4815-b690-ad78f083be25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-354810001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347ed9c1-9ad3-4fa6-baac-7805a6da39c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccc3f7588de4eebb53d0455f87e1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:08Z,use_quota=True,user_id='6a48c21403f84ccbbf4ada6c2fe2492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d42e87-91ae-407e-b134-c374a91d2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d42e87-91ae-407e-b134-c374a91d2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea34a09f-3d3d-432a-94bb-1454b9d8b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea34a09f-3d3d-432a-94bb-1454b9d8b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347ed9c1-9ad3-4fa6-baac-7805a6da39c6', 'volume_name': 'volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2efcb9-1dc8-4c7b-8885-ba30d8f07a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2efcb9-1dc8-4c7b-8885-ba30d8f07a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272c749d-1fc8-4220-af70-123713455d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:08 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Volume 347ed9c1-9ad3-4fa6-baac-7805a6da39c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6', 'volume_size': 1}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-354810001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347ed9c1-9ad3-4fa6-baac-7805a6da39c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccc3f7588de4eebb53d0455f87e1171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:08Z,use_quota=True,user_id='6a48c21403f84ccbbf4ada6c2fe2492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Creating volume 347ed9c1-9ad3-4fa6-baac-7805a6da39c6 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:08 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:08 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=130, name=volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 1073741824" returned: 0 in 0.331s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272c749d-1fc8-4220-af70-123713455d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5e1643-9a7d-407e-9ed1-26176d57faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:09 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Volume volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 (347ed9c1-9ad3-4fa6-baac-7805a6da39c6): created successfully
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5e1643-9a7d-407e-9ed1-26176d57faf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Flow 'volume_create_manager' (dacea7e7-a399-4f3d-9372-97bb2e9c65c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-01c4ec74-a578-49f7-a680-27d31c00458b tempest-VolumesTransfersV357Test-424308472 None] Created volume successfully.
Sep 10 17:48:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "cinder-347ed9c1-9ad3-4fa6-baac-7805a6da39c6-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-347ed9c1-9ad3-4fa6-baac-7805a6da39c6-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "cinder-quobyte-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-quobyte-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" acquired by "delete_volume" :: waited 0.020s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b83f4-58ae-4486-88c5-bcd1d4b0a818]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" returned: 0 in 0.563s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" returned: 0 in 0.141s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-quobyte-347ed9c1-9ad3-4fa6-baac-7805a6da39c6" released by "delete_volume" :: held 0.895s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Created reservations ['034cc42d-1d36-40a9-a1e8-5fba268e3683', '266158c3-90a6-4021-984b-f701d958ba46', '6d0c8f26-d70b-4937-89c0-e4a09b6c9b7b', '505cb027-30af-4efb-a86b-2827b7e565f2'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.082s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Deleted volume successfully.
Sep 10 17:48:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ee3f74ec-79b4-4761-afb9-17a7a90a706f tempest-VolumesTransfersV357Test-654967883 None] Lock "cinder-347ed9c1-9ad3-4fa6-baac-7805a6da39c6-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:19 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Flow 'volume_create_manager' (483eabea-95e3-4e6c-93bd-aa434ec2a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e4ef9e-7bfd-433c-bf46-22b88338ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e4ef9e-7bfd-433c-bf46-22b88338ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-917359326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3027eb6-91ed-4a81-bf8d-8fd17f9d150e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2084327b0c4676b6a35a68c194b4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:19Z,use_quota=True,user_id='09f810458c2a418cae4eb031d240e983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ca19a-1146-4099-a854-60c333fb2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ca19a-1146-4099-a854-60c333fb2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63648fa-1123-43a9-9dde-e79092c7fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63648fa-1123-43a9-9dde-e79092c7fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3027eb6-91ed-4a81-bf8d-8fd17f9d150e', 'volume_name': 'volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e', 'volume_size': 2}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f65f72-3d3e-44cc-8e86-b504f5f820fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f65f72-3d3e-44cc-8e86-b504f5f820fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66255dac-e1ea-4c88-821f-11e734208599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Volume f3027eb6-91ed-4a81-bf8d-8fd17f9d150e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e', 'volume_size': 2}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-917359326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3027eb6-91ed-4a81-bf8d-8fd17f9d150e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2084327b0c4676b6a35a68c194b4db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:19Z,use_quota=True,user_id='09f810458c2a418cae4eb031d240e983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Creating volume f3027eb6-91ed-4a81-bf8d-8fd17f9d150e {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:19 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e 2147483648 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:19 devstack quobyte-client[82918]: System call of process 98972 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:48:19 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=131, name=volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e 2147483648" returned: 0 in 0.571s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" returned: 0 in 0.110s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66255dac-e1ea-4c88-821f-11e734208599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e', 'volume_size': 2}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28773c9a-1d03-4300-a953-77c38724a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:20 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Volume volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e (f3027eb6-91ed-4a81-bf8d-8fd17f9d150e): created successfully
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28773c9a-1d03-4300-a953-77c38724a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:20 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Flow 'volume_create_manager' (483eabea-95e3-4e6c-93bd-aa434ec2a693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:20 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d0e2a4cf-df9c-492b-a61c-3d863dbf58ba tempest-VolumesCloneNegativeTest-1981663310 None] Created volume successfully.
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Acquiring lock "cinder-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "cinder-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Acquiring lock "cinder-quobyte-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "cinder-quobyte-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" acquired by "delete_volume" :: waited 0.012s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e03d5-6f6f-415f-b239-514a9ffa92f4]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" returned: 0 in 0.452s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "cinder-quobyte-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e" released by "delete_volume" :: held 0.712s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Created reservations ['cd3f5253-aa01-4c98-8245-799477557c5d', '26c31cb7-be86-4a58-af0f-e75a4a2e2065', '695a080e-aaa4-40d3-adc8-f1a552131f40', '3a138430-3fd8-46a1-a66a-003b57242a6b'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.115s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Deleted volume successfully.
Sep 10 17:48:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5cd3ff90-5340-48f5-8ac5-b51d9c49a85b tempest-VolumesCloneNegativeTest-1981663310 None] Lock "cinder-f3027eb6-91ed-4a81-bf8d-8fd17f9d150e-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:26 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (da76352a-a52c-4e23-952d-df96a9d05fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad95320a-0d23-43d5-bef5-e095f629ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad95320a-0d23-43d5-bef5-e095f629ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1087386500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab90653-7b81-4212-9d05-79f0131f5eab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:27Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93c229-bd51-40e2-8815-0cb6d94ec5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e93c229-bd51-40e2-8815-0cb6d94ec5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c554e40-ff12-4830-bbbd-7bccfeae75b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c554e40-ff12-4830-bbbd-7bccfeae75b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab90653-7b81-4212-9d05-79f0131f5eab', 'volume_name': 'volume-7ab90653-7b81-4212-9d05-79f0131f5eab', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb1b052-d438-4a37-b899-aad5c12683c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb1b052-d438-4a37-b899-aad5c12683c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130facaf-7239-491c-9cab-026da60e134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:26 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Volume 7ab90653-7b81-4212-9d05-79f0131f5eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab90653-7b81-4212-9d05-79f0131f5eab', 'volume_size': 1}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1087386500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab90653-7b81-4212-9d05-79f0131f5eab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:27Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Creating volume 7ab90653-7b81-4212-9d05-79f0131f5eab {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:26 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:27 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=132, name=volume-7ab90653-7b81-4212-9d05-79f0131f5eab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab 1073741824" returned: 0 in 0.361s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.535s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130facaf-7239-491c-9cab-026da60e134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab90653-7b81-4212-9d05-79f0131f5eab', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa27672-0598-4b5a-ba6a-b9c117ed4010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:27 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Volume volume-7ab90653-7b81-4212-9d05-79f0131f5eab (7ab90653-7b81-4212-9d05-79f0131f5eab): created successfully
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa27672-0598-4b5a-ba6a-b9c117ed4010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:27 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (da76352a-a52c-4e23-952d-df96a9d05fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-45251ac1-2381-42d1-8049-84c9d0d17f28 tempest-VolumesListTestJSON-1772023855 None] Created volume successfully.
Sep 10 17:48:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (c36338e3-87d2-4bf2-9e67-97df2b64ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ea7388-aba6-40fd-b63e-7cfb4db69ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ea7388-aba6-40fd-b63e-7cfb4db69ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-528603351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9122fa3-bf12-44b0-a06e-b52966a35750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:29Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9716a783-c3fe-4df6-9a33-ba61247cca58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9716a783-c3fe-4df6-9a33-ba61247cca58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de20d712-8bb4-4f9b-b08e-5f0b0b66998e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de20d712-8bb4-4f9b-b08e-5f0b0b66998e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9122fa3-bf12-44b0-a06e-b52966a35750', 'volume_name': 'volume-d9122fa3-bf12-44b0-a06e-b52966a35750', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef00b403-b8e3-472b-9b77-8edc33f7cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef00b403-b8e3-472b-9b77-8edc33f7cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d73ebce-fefd-4a66-879b-5d6b24a72bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Volume d9122fa3-bf12-44b0-a06e-b52966a35750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9122fa3-bf12-44b0-a06e-b52966a35750', 'volume_size': 1}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-528603351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9122fa3-bf12-44b0-a06e-b52966a35750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:29Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Creating volume d9122fa3-bf12-44b0-a06e-b52966a35750 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:28 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:29 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=133, name=volume-d9122fa3-bf12-44b0-a06e-b52966a35750, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750 1073741824" returned: 0 in 0.350s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] <== create_volume: return (539ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.550s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d73ebce-fefd-4a66-879b-5d6b24a72bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9122fa3-bf12-44b0-a06e-b52966a35750', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b147d3-4b9e-4a2d-867d-8ef7a19f9229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Volume volume-d9122fa3-bf12-44b0-a06e-b52966a35750 (d9122fa3-bf12-44b0-a06e-b52966a35750): created successfully
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b147d3-4b9e-4a2d-867d-8ef7a19f9229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (c36338e3-87d2-4bf2-9e67-97df2b64ea83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:30 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3531d108-fab4-4f48-b5b4-dbf11024723f tempest-VolumesListTestJSON-1772023855 None] Created volume successfully.
Sep 10 17:48:31 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (d147bc59-5421-4f9c-bbe1-ff0b2c5822c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f589a82-3436-44a6-aa4e-6769f0e7321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f589a82-3436-44a6-aa4e-6769f0e7321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1607273622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8386690a-e5f8-4d88-aac2-dd68a4712739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:31Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177cb1f-841f-4a47-b999-acf98c324ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c177cb1f-841f-4a47-b999-acf98c324ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53cd7be-f75b-433b-88f2-52b061bfc1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53cd7be-f75b-433b-88f2-52b061bfc1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8386690a-e5f8-4d88-aac2-dd68a4712739', 'volume_name': 'volume-8386690a-e5f8-4d88-aac2-dd68a4712739', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a468ae4-2601-4d62-b060-aa664451ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a468ae4-2601-4d62-b060-aa664451ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ea17fe-94a0-4310-9e73-de5c049df379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:31 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Volume 8386690a-e5f8-4d88-aac2-dd68a4712739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8386690a-e5f8-4d88-aac2-dd68a4712739', 'volume_size': 1}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1607273622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8386690a-e5f8-4d88-aac2-dd68a4712739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='96fe3c3800524b31a5a1edc5fad6be45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:48:31Z,use_quota=True,user_id='601e28af614b46d3b20888b6f60a8e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Creating volume 8386690a-e5f8-4d88-aac2-dd68a4712739 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:48:31 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:31 devstack quobyte-client[82918]: System call of process 98990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:48:31 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=134, name=volume-8386690a-e5f8-4d88-aac2-dd68a4712739, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739 1073741824" returned: 0 in 0.366s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739" returned: 0 in 0.083s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ea17fe-94a0-4310-9e73-de5c049df379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8386690a-e5f8-4d88-aac2-dd68a4712739', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b7afc7-4547-4821-8b5f-8bdfa6150921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:48:32 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Volume volume-8386690a-e5f8-4d88-aac2-dd68a4712739 (8386690a-e5f8-4d88-aac2-dd68a4712739): created successfully
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b7afc7-4547-4821-8b5f-8bdfa6150921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:48:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Flow 'volume_create_manager' (d147bc59-5421-4f9c-bbe1-ff0b2c5822c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:48:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4f647c80-a626-4c1a-924e-a46f68c3fcd7 tempest-VolumesListTestJSON-1772023855 None] Created volume successfully.
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-8386690a-e5f8-4d88-aac2-dd68a4712739-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-8386690a-e5f8-4d88-aac2-dd68a4712739-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-quobyte-8386690a-e5f8-4d88-aac2-dd68a4712739" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-8386690a-e5f8-4d88-aac2-dd68a4712739" acquired by "delete_volume" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff12bb-aa47-4afc-b488-c75666489473]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739" returned: 0 in 0.546s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8386690a-e5f8-4d88-aac2-dd68a4712739" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-8386690a-e5f8-4d88-aac2-dd68a4712739" released by "delete_volume" :: held 0.812s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Created reservations ['5170b092-ea09-446a-bf80-cb4105e1bdc1', '3b9e443a-901e-45de-8aa5-73541c925f66', '1b94b069-a1e9-4b88-953d-bd2efcbd2ebd', '3be944ba-d60c-4fd5-a0c1-fd5bd39882f0'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.088s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:38 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:39 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Deleted volume successfully.
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-14d87ffb-6151-4b82-93ee-9e8f4d80d008 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-8386690a-e5f8-4d88-aac2-dd68a4712739-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-d9122fa3-bf12-44b0-a06e-b52966a35750-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-d9122fa3-bf12-44b0-a06e-b52966a35750-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=37,cinder:UPDATE=68,cinder:INSERT=14,cinder:DELETE=6 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:48:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-quobyte-d9122fa3-bf12-44b0-a06e-b52966a35750" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-d9122fa3-bf12-44b0-a06e-b52966a35750" acquired by "delete_volume" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[146cddba-c60c-4a25-a93f-49bc34b66869]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750" returned: 0 in 0.402s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-d9122fa3-bf12-44b0-a06e-b52966a35750" returned: 0 in 0.090s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-d9122fa3-bf12-44b0-a06e-b52966a35750" released by "delete_volume" :: held 0.647s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=62,cinder:SELECT=45,cinder:DELETE=8,cinder:INSERT=10 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:48:40 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Created reservations ['695c51dc-b83b-4d8b-a55b-27b48566ead3', '4668e602-cd6d-4b0a-a7ac-339ad28265c2', '9fedbf2b-f331-4d01-8aeb-d46dbdc9f6db', 'ffbd7cdf-5f7e-4251-8740-bd0ca2f70ae7'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.083s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Deleted volume successfully.
Sep 10 17:48:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e257d1f0-cda5-4389-a7be-a9b233fd8d2c tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-d9122fa3-bf12-44b0-a06e-b52966a35750-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-7ab90653-7b81-4212-9d05-79f0131f5eab-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-7ab90653-7b81-4212-9d05-79f0131f5eab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:42 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "cinder-quobyte-7ab90653-7b81-4212-9d05-79f0131f5eab" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-7ab90653-7b81-4212-9d05-79f0131f5eab" acquired by "delete_volume" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f545af3-811e-4fba-8811-1e3c507885b9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab" returned: 0 in 0.411s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7ab90653-7b81-4212-9d05-79f0131f5eab" returned: 0 in 0.095s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:42 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-quobyte-7ab90653-7b81-4212-9d05-79f0131f5eab" released by "delete_volume" :: held 0.659s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Created reservations ['915df430-df45-4b7d-b3bc-cede94073e3f', '5c41e142-2c8b-4e6e-bb90-bba353ed5897', '34c14e69-a99d-4f89-afae-5cafbb89dd0a', 'f92d05ed-1c34-4db0-b137-d62fdce401de'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.111s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:48:43 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Deleted volume successfully.
Sep 10 17:48:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-76c98b6a-15f3-4c5f-b542-399851949319 tempest-VolumesListTestJSON-1772023855 None] Lock "cinder-7ab90653-7b81-4212-9d05-79f0131f5eab-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:48:53 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:48:53 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:INSERT=2,cinder:UPDATE=13,cinder:SELECT=7,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.124s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:49:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:49:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Flow 'volume_create_manager' (0fdbe6e3-be79-477f-9a6e-c078d61a2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ec73fe-1732-444e-a705-8e0bb03b5d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ec73fe-1732-444e-a705-8e0bb03b5d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-507979982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237ea076-dca5-45db-b64c-d4bc36d11470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8877bcbee0e94c3f8cc7d77551d7edd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:11Z,use_quota=True,user_id='b195dab1d5a347c48241232fcc54f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3bf04f-f7e9-464b-bf39-57df471cfcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3bf04f-f7e9-464b-bf39-57df471cfcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a00079-1782-4a0c-8663-5acc6ecf9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a00079-1782-4a0c-8663-5acc6ecf9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237ea076-dca5-45db-b64c-d4bc36d11470', 'volume_name': 'volume-237ea076-dca5-45db-b64c-d4bc36d11470', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c825ebb6-5ac8-463a-b491-3a1e2a033278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c825ebb6-5ac8-463a-b491-3a1e2a033278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b4751-28d9-4c7e-a61e-8752977f9e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:11 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume 237ea076-dca5-45db-b64c-d4bc36d11470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237ea076-dca5-45db-b64c-d4bc36d11470', 'volume_size': 1}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-507979982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237ea076-dca5-45db-b64c-d4bc36d11470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8877bcbee0e94c3f8cc7d77551d7edd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:11Z,use_quota=True,user_id='b195dab1d5a347c48241232fcc54f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Creating volume 237ea076-dca5-45db-b64c-d4bc36d11470 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:49:11 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:49:12 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:49:12 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=135, name=volume-237ea076-dca5-45db-b64c-d4bc36d11470, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 1073741824" returned: 0 in 0.931s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:49:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:49:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Flow 'volume_create_manager' (1848b962-3dfb-4a50-961b-03d562610a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058b21d3-295a-4249-8a9b-dd342746bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058b21d3-295a-4249-8a9b-dd342746bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1737226529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8d2043-c913-46e7-a1ce-9fcac1ff38e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8877bcbee0e94c3f8cc7d77551d7edd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:12Z,use_quota=True,user_id='b195dab1d5a347c48241232fcc54f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dff20-dcd2-4b1c-96c6-192cc477e30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2dff20-dcd2-4b1c-96c6-192cc477e30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca88692-6a59-4307-bb0b-0fe15ee48984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca88692-6a59-4307-bb0b-0fe15ee48984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8d2043-c913-46e7-a1ce-9fcac1ff38e6', 'volume_name': 'volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6363af-4d09-445a-acdd-9b6394e1d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6363af-4d09-445a-acdd-9b6394e1d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d3690e-0302-4e50-bf35-aa2227be9ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:13 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume 1d8d2043-c913-46e7-a1ce-9fcac1ff38e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6', 'volume_size': 1}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470" returned: 0 in 0.775s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] <== create_volume: return (1760ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1737226529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8d2043-c913-46e7-a1ce-9fcac1ff38e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8877bcbee0e94c3f8cc7d77551d7edd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:49:12Z,use_quota=True,user_id='b195dab1d5a347c48241232fcc54f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Creating volume 1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:49:13 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:49:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:49:13 devstack quobyte-client[82918]: System call of process 99059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:49:13 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=136, name=volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b4751-28d9-4c7e-a61e-8752977f9e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237ea076-dca5-45db-b64c-d4bc36d11470', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab60dcb5-4b2f-4c3e-87b2-3ee30fb2eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:14 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume volume-237ea076-dca5-45db-b64c-d4bc36d11470 (237ea076-dca5-45db-b64c-d4bc36d11470): created successfully
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab60dcb5-4b2f-4c3e-87b2-3ee30fb2eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Flow 'volume_create_manager' (0fdbe6e3-be79-477f-9a6e-c078d61a2b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 1073741824" returned: 0 in 0.513s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:49:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2b10f746-314d-46da-90c2-da9131898220 tempest-TestServerVolumeAttachmentScenario-187584311 None] Created volume successfully.
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" returned: 0 in 0.264s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] <== create_volume: return (803ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d3690e-0302-4e50-bf35-aa2227be9ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09dd14-332d-4b4f-8171-408a2652c290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:49:14 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 (1d8d2043-c913-46e7-a1ce-9fcac1ff38e6): created successfully
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09dd14-332d-4b4f-8171-408a2652c290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:49:14 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Flow 'volume_create_manager' (1848b962-3dfb-4a50-961b-03d562610a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:49:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-acdbae2f-85d0-4e64-9612-09dcb1b03b83 tempest-TestServerVolumeAttachmentScenario-187584311 None] Created volume successfully.
Sep 10 17:49:24 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:49:24 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.089s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:50:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:50:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:50:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ef321-4cc6-49d9-9bca-220659944c4d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470" returned: 0 in 0.457s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.532s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:50:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-237ea076-dca5-45db-b64c-d4bc36d11470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d58ea7b-107c-458a-a251-97c49882bc46', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:50:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:50:53 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-4460f7ba-299b-4087-9b0e-be9d8804e381 req-8d359299-182c-40f5-a142-cfc371fcecea tempest-TestServerVolumeAttachmentScenario-187584311 None] attachment_update completed successfully.
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.141s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:51:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:51:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:51:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:51:05 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[495eeace-d4d8-4d98-8a79-f79409fb9f66]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:51:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:51:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" returned: 0 in 0.432s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:51:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.497s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:51:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e', 'name': 'volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e4d5b4c-a8c3-4108-91cd-5314b1f4c87a', 'enforce_multipath': True} {{(pid=82884) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 17:51:06 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:51:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-2e623c71-0caf-400b-902e-0abc3e5d3551 req-43e61f94-3f8c-42f3-9438-d6a8ea64f620 tempest-TestServerVolumeAttachmentScenario-187584311 None] attachment_update completed successfully.
Sep 10 17:51:16 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:16 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-5a909910-3ccb-48dd-9814-93580915dd1c req-9f34ba4c-3c31-4f7a-9aad-5631cdc890cd tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:51:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-5a909910-3ccb-48dd-9814-93580915dd1c req-9f34ba4c-3c31-4f7a-9aad-5631cdc890cd tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:51:35 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-5a909910-3ccb-48dd-9814-93580915dd1c req-9f34ba4c-3c31-4f7a-9aad-5631cdc890cd tempest-TestServerVolumeAttachmentScenario-187584311 None] Terminate volume connection completed successfully.
Sep 10 17:51:35 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-5a909910-3ccb-48dd-9814-93580915dd1c req-9f34ba4c-3c31-4f7a-9aad-5631cdc890cd tempest-TestServerVolumeAttachmentScenario-187584311 None] Deleting attachment 9e4d5b4c-a8c3-4108-91cd-5314b1f4c87a. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:51:45 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:45 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:51:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-66734348-4d1a-41c6-91f2-bcce0e2a8bb9 req-f9bb1a85-a773-4d9e-be0b-2027bb5a07f4 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:51:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [req-66734348-4d1a-41c6-91f2-bcce0e2a8bb9 req-f9bb1a85-a773-4d9e-be0b-2027bb5a07f4 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:51:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [req-66734348-4d1a-41c6-91f2-bcce0e2a8bb9 req-f9bb1a85-a773-4d9e-be0b-2027bb5a07f4 tempest-TestServerVolumeAttachmentScenario-187584311 None] Terminate volume connection completed successfully.
Sep 10 17:51:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [req-66734348-4d1a-41c6-91f2-bcce0e2a8bb9 req-f9bb1a85-a773-4d9e-be0b-2027bb5a07f4 tempest-TestServerVolumeAttachmentScenario-187584311 None] Deleting attachment 0d58ea7b-107c-458a-a251-97c49882bc46. {{(pid=82884) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.200s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:09 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:52:09 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=1 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "cinder-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "cinder-quobyte-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-quobyte-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" acquired by "delete_volume" :: waited 0.021s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b45d93-8b12-4a41-8791-6811abaf7d9e]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" returned: 0 in 0.407s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" returned: 0 in 0.082s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-quobyte-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6" released by "delete_volume" :: held 0.654s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Created reservations ['d9b8f301-3e4d-4ffd-8f3f-b69708ba55ae', '3132a4bd-65b8-4832-9565-cab03583352f', '4fe3e48e-2461-4702-8839-31e801ab3601', '401ffce8-e1d0-4f74-b168-d43e9008e6a0'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.085s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:13 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:13 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Deleted volume successfully.
Sep 10 17:52:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5335aa2-e320-43f1-9575-28c7b25cc7e1 tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-1d8d2043-c913-46e7-a1ce-9fcac1ff38e6-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "cinder-237ea076-dca5-45db-b64c-d4bc36d11470-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-237ea076-dca5-45db-b64c-d4bc36d11470-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:14 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "cinder-quobyte-237ea076-dca5-45db-b64c-d4bc36d11470" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-quobyte-237ea076-dca5-45db-b64c-d4bc36d11470" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f9dc45-219a-40f7-ae4e-7c0676f7076f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470" returned: 0 in 0.398s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-237ea076-dca5-45db-b64c-d4bc36d11470" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-quobyte-237ea076-dca5-45db-b64c-d4bc36d11470" released by "delete_volume" :: held 0.640s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Created reservations ['6a93174a-9e56-4f62-bd85-973827cae118', '62a3b17c-3e62-41d6-9603-d77b3d589baf', '0fa68332-763d-4baf-ad96-5f474ef8f37c', 'cf42f822-62d8-44ed-8aea-09ec242a873b'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.104s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:15 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Deleted volume successfully.
Sep 10 17:52:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4b318cb6-a43f-4bb0-82b4-ab9dc88bb34b tempest-TestServerVolumeAttachmentScenario-187584311 None] Lock "cinder-237ea076-dca5-45db-b64c-d4bc36d11470-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:25 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=22 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:52:25 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:52:32 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (3c5b9889-27f6-4a1f-866f-257e150ad6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ff33e-28a5-4f72-ba35-529cc787f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ff33e-28a5-4f72-ba35-529cc787f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312065991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50edf94-7116-49f2-913d-22c56cc53de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:33Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0c5bb1-a6c5-4784-9e2d-431064e26315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b0c5bb1-a6c5-4784-9e2d-431064e26315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15d7df8-a374-47a4-a40d-8314b16b5b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15d7df8-a374-47a4-a40d-8314b16b5b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50edf94-7116-49f2-913d-22c56cc53de4', 'volume_name': 'volume-a50edf94-7116-49f2-913d-22c56cc53de4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00b36a5-8432-4f99-b7bd-a36428b20954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00b36a5-8432-4f99-b7bd-a36428b20954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df3c578-a0ca-441c-b9c2-485d40e9059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:32 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume a50edf94-7116-49f2-913d-22c56cc53de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50edf94-7116-49f2-913d-22c56cc53de4', 'volume_size': 1}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312065991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50edf94-7116-49f2-913d-22c56cc53de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:33Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:32 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:33 devstack quobyte-client[82918]: System call of process 99898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:33 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=137, name=volume-a50edf94-7116-49f2-913d-22c56cc53de4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 1073741824" returned: 0 in 0.436s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4" returned: 0 in 0.304s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (789ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df3c578-a0ca-441c-b9c2-485d40e9059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50edf94-7116-49f2-913d-22c56cc53de4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08617ce2-8329-4f11-8202-388a8e760072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:33 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-a50edf94-7116-49f2-913d-22c56cc53de4 (a50edf94-7116-49f2-913d-22c56cc53de4): created successfully
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08617ce2-8329-4f11-8202-388a8e760072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:33 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (3c5b9889-27f6-4a1f-866f-257e150ad6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-394dce3d-b0cb-4eaf-9d12-319f903e88e1 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:35 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating offline snapshot 29fff9f5-d059-42e9-8dec-72c45a7562ac of volume a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[768d2c6f-2196-49d7-b564-8f3ee69faf49]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4" returned: 0 in 0.414s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:35 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=138, name=volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac 1G" returned: 0 in 0.233s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a50edf94-7116-49f2-913d-22c56cc53de4 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img rebase -u -b volume-a50edf94-7116-49f2-913d-22c56cc53de4 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.135s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:52:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.097s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.083s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.info" returned: 0 in 0.102s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.info" returned: 0 in 0.081s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.434s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:36 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-06554804-5e76-4917-b722-9f4450d7180f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Create snapshot completed successfully
Sep 10 17:52:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (ee0a6166-5243-4523-a4b4-5dc1cedbf543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b7c9b1-60b6-42e8-bf24-865ffbae35e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b7c9b1-60b6-42e8-bf24-865ffbae35e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828784172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:37Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2459b014-a2f0-4b27-b836-40fcd43d5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2459b014-a2f0-4b27-b836-40fcd43d5e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6ce72e-5992-455b-b455-8c5ea3a7adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6ce72e-5992-455b-b455-8c5ea3a7adb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd', 'volume_name': 'volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749eee86-092e-4128-8363-8042391ef1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749eee86-092e-4128-8363-8042391ef1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca970279-0fa2-4eda-a43e-55c030d26aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:37 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd', 'volume_size': 1}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828784172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:37Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:37 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:37 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=140, name=volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd 1073741824" returned: 0 in 0.530s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (5761ac08-1fce-4ecb-a867-4b6381c9b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96933f6-4693-441c-ad32-a3283fd51b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" returned: 0 in 0.505s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (1071ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96933f6-4693-441c-ad32-a3283fd51b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3780473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:38Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fff478-a663-4aec-b5dc-5254dc228ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fff478-a663-4aec-b5dc-5254dc228ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f7cbfc-f7b4-4041-a331-250262acf05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f7cbfc-f7b4-4041-a331-250262acf05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8', 'volume_name': 'volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2129910e-be97-4dd1-b5bb-fc6a64991b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2129910e-be97-4dd1-b5bb-fc6a64991b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4068cf77-ac6c-49e4-a9ae-fb6ea3ea42f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:38 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8', 'volume_size': 1}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3780473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:38Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:38 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:39 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=141, name=volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca970279-0fa2-4eda-a43e-55c030d26aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2863df7-1158-4c37-a2ce-933f83ff6b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (77c17971-93e8-4c13-833c-79e9c7649908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4039da-002a-46d3-ba53-4ee36ed1e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:39 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd (b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd): created successfully
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2863df7-1158-4c37-a2ce-933f83ff6b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (ee0a6166-5243-4523-a4b4-5dc1cedbf543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 1073741824" returned: 0 in 0.820s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:39 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (b2bc7a24-2ccd-4ccd-8371-b5c245715a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:39 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1a1547-3d02-405f-ac00-9e8ddb66855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4039da-002a-46d3-ba53-4ee36ed1e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122463526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f978fd5f-f89b-4968-ab92-9b7acc63459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:38Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6a2d38-1233-4cd5-a4d4-f99d8d56cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6a2d38-1233-4cd5-a4d4-f99d8d56cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe56d2b-8582-4030-a6b6-241226f24825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe56d2b-8582-4030-a6b6-241226f24825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f978fd5f-f89b-4968-ab92-9b7acc63459b', 'volume_name': 'volume-f978fd5f-f89b-4968-ab92-9b7acc63459b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55db2d37-ec54-4d03-91f5-4ccee401c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55db2d37-ec54-4d03-91f5-4ccee401c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab90454-3edc-48db-8f3c-2e11b35ca59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume f978fd5f-f89b-4968-ab92-9b7acc63459b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f978fd5f-f89b-4968-ab92-9b7acc63459b', 'volume_size': 1}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1a1547-3d02-405f-ac00-9e8ddb66855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-787777855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc6ad5-fd93-4431-a461-9f9f11536329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:39Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814fc85c-b961-4686-b436-e6f3c91b7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814fc85c-b961-4686-b436-e6f3c91b7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f341c03-e039-40f7-a060-680c43765696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f341c03-e039-40f7-a060-680c43765696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fc6ad5-fd93-4431-a461-9f9f11536329', 'volume_name': 'volume-87fc6ad5-fd93-4431-a461-9f9f11536329', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d25fad2-1e29-4470-b7c2-4e0bca8774de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d25fad2-1e29-4470-b7c2-4e0bca8774de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecda453-1c0c-48e2-bf2a-db0522c25fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume 87fc6ad5-fd93-4431-a461-9f9f11536329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fc6ad5-fd93-4431-a461-9f9f11536329', 'volume_size': 1}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ed9b688d-261a-4ef5-9260-586038a52d91 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" returned: 0 in 0.522s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (1365ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122463526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f978fd5f-f89b-4968-ab92-9b7acc63459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:38Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume f978fd5f-f89b-4968-ab92-9b7acc63459b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:52:40 devstack quobyte-client[82918]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:40 devstack quobyte-client[82918]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:40 devstack quobyte-client[82918]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:40 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=142, name=volume-f978fd5f-f89b-4968-ab92-9b7acc63459b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (7d9dc8b4-3df1-4288-a003-a6ecdfcf8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327f0b55-ad10-4aa1-bc43-b26f864d5795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327f0b55-ad10-4aa1-bc43-b26f864d5795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014061424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea101713-6da9-4d15-a907-83e68b1f0378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:40Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bd41bb-3dbf-439f-ac3d-d144ad81fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bd41bb-3dbf-439f-ac3d-d144ad81fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bfecb7-99a2-4099-bbe9-d1f1f7aa72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bfecb7-99a2-4099-bbe9-d1f1f7aa72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea101713-6da9-4d15-a907-83e68b1f0378', 'volume_name': 'volume-ea101713-6da9-4d15-a907-83e68b1f0378', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48add288-60b0-43b3-bea6-5402f9932215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48add288-60b0-43b3-bea6-5402f9932215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30416d95-ade7-4ff7-a659-7e7c9646e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume ea101713-6da9-4d15-a907-83e68b1f0378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea101713-6da9-4d15-a907-83e68b1f0378', 'volume_size': 1}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4068cf77-ac6c-49e4-a9ae-fb6ea3ea42f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33210762-ce71-437a-9b46-1b1a3ad1c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b 1073741824" returned: 0 in 0.577s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 (f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8): created successfully
Sep 10 17:52:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33210762-ce71-437a-9b46-1b1a3ad1c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (5761ac08-1fce-4ecb-a867-4b6381c9b961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b" returned: 0 in 0.298s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (893ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-787777855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc6ad5-fd93-4431-a461-9f9f11536329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:39Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume 87fc6ad5-fd93-4431-a461-9f9f11536329 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:41 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:41 devstack quobyte-client[82918]: System call of process 99928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:41 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=143, name=volume-87fc6ad5-fd93-4431-a461-9f9f11536329, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-98e612b9-df16-4d10-a2b7-092733f3230d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab90454-3edc-48db-8f3c-2e11b35ca59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f978fd5f-f89b-4968-ab92-9b7acc63459b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd6033d-92ea-4ded-979c-78fa37ab790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:41 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-f978fd5f-f89b-4968-ab92-9b7acc63459b (f978fd5f-f89b-4968-ab92-9b7acc63459b): created successfully
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd6033d-92ea-4ded-979c-78fa37ab790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (77c17971-93e8-4c13-833c-79e9c7649908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329 1073741824" returned: 0 in 0.521s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f9758ace-38f4-4c8f-aa62-b875dd7a4747 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329" returned: 0 in 0.311s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.263s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014061424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea101713-6da9-4d15-a907-83e68b1f0378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842da365277246dcaa73c3731315cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:52:40Z,use_quota=True,user_id='ecf64bbd36cd44a8abb8df10ccb1cf82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Creating volume ea101713-6da9-4d15-a907-83e68b1f0378 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:52:42 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:42 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=144, name=volume-ea101713-6da9-4d15-a907-83e68b1f0378, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecda453-1c0c-48e2-bf2a-db0522c25fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fc6ad5-fd93-4431-a461-9f9f11536329', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9cbe10-d079-4659-8380-84979bfbdfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:42 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-87fc6ad5-fd93-4431-a461-9f9f11536329 (87fc6ad5-fd93-4431-a461-9f9f11536329): created successfully
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9cbe10-d079-4659-8380-84979bfbdfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (b2bc7a24-2ccd-4ccd-8371-b5c245715a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:42 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5a5aed86-b32d-4b59-b9e6-f40c7ff07ade tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378 1073741824" returned: 0 in 0.652s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378" returned: 0 in 0.196s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] <== create_volume: return (908ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:52:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30416d95-ade7-4ff7-a659-7e7c9646e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea101713-6da9-4d15-a907-83e68b1f0378', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70af03-f253-4415-bbb3-679172fca822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:52:43 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume volume-ea101713-6da9-4d15-a907-83e68b1f0378 (ea101713-6da9-4d15-a907-83e68b1f0378): created successfully
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70af03-f253-4415-bbb3-679172fca822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Flow 'volume_create_manager' (7d9dc8b4-3df1-4288-a003-a6ecdfcf8159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:52:43 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-04c14a55-da79-45c2-8dba-b7330f670d61 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created volume successfully.
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-ea101713-6da9-4d15-a907-83e68b1f0378-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-ea101713-6da9-4d15-a907-83e68b1f0378-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-ea101713-6da9-4d15-a907-83e68b1f0378" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:43 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-ea101713-6da9-4d15-a907-83e68b1f0378" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a7d40e-1534-46d3-bf87-382540357aa0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378" returned: 0 in 0.465s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ea101713-6da9-4d15-a907-83e68b1f0378" returned: 0 in 0.093s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:44 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-ea101713-6da9-4d15-a907-83e68b1f0378" released by "delete_volume" :: held 0.715s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['0f73bb4a-0615-4d2c-9a44-207c5f4bf0e6', '1cb874c3-3bdf-45fd-9ca3-25ef0867452e', 'c10add15-3cb9-4c89-9956-98460300c03e', 'f4e0b837-9e9e-4db6-9491-b806b769442d'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.091s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-20e69a4b-353b-4923-8be4-e7a6ec24a0a9 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-ea101713-6da9-4d15-a907-83e68b1f0378-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-87fc6ad5-fd93-4431-a461-9f9f11536329-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-87fc6ad5-fd93-4431-a461-9f9f11536329-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:46 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-87fc6ad5-fd93-4431-a461-9f9f11536329" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-87fc6ad5-fd93-4431-a461-9f9f11536329" acquired by "delete_volume" :: waited 0.011s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd358b53-6f52-426f-b17c-609c8b70e91b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329" returned: 0 in 0.432s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-87fc6ad5-fd93-4431-a461-9f9f11536329" returned: 0 in 0.089s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-87fc6ad5-fd93-4431-a461-9f9f11536329" released by "delete_volume" :: held 0.687s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['157c0b42-5c10-4d6a-b320-c8fc3f7ccff6', '659bd523-772d-4c27-a606-28d7b108a8f6', '2d95fbbb-2ad3-4fbf-b0af-738c62a20963', '05de84e3-4231-4d3c-ab0a-ad9ae5e02095'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.087s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-73ddde0a-5aee-48a9-81fd-7cd3afa6733d tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-87fc6ad5-fd93-4431-a461-9f9f11536329-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-f978fd5f-f89b-4968-ab92-9b7acc63459b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-f978fd5f-f89b-4968-ab92-9b7acc63459b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-f978fd5f-f89b-4968-ab92-9b7acc63459b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-f978fd5f-f89b-4968-ab92-9b7acc63459b" acquired by "delete_volume" :: waited 0.017s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb586e-75c0-412d-8a76-4a1e0daaa0ee]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b" returned: 0 in 0.413s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f978fd5f-f89b-4968-ab92-9b7acc63459b" returned: 0 in 0.094s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-f978fd5f-f89b-4968-ab92-9b7acc63459b" released by "delete_volume" :: held 0.672s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['cbdbd843-35a5-405d-9284-f7d3d138ebff', 'fdc4cd60-106c-415b-bba3-a9011c63a225', '0df2ffee-2b11-4204-86e9-e349ba3720ef', 'a098b441-b610-427a-a577-20221435b81c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.102s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:49 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-cb542623-d9de-407f-99d1-a8dd1447c64b tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-f978fd5f-f89b-4968-ab92-9b7acc63459b-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" acquired by "delete_volume" :: waited 0.015s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[232641bb-a31a-4f65-a2d2-3688541c2cb9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" returned: 0 in 0.443s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" returned: 0 in 0.088s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8" released by "delete_volume" :: held 0.700s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['463f2be9-a572-4b4a-a985-ba0c426c6284', 'b915c624-f8bc-4649-acfa-edbb36720312', '11dce649-47fb-4ca3-9749-de215eac592d', '683fcbe9-4378-4a82-87f0-6eb86a2628bb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.084s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-5e35e555-9fd7-4461-9f1a-9e9369eaa971 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-f7f17ee2-e8e9-48eb-ac23-f7c08d9dd1c8-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:53 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" acquired by "delete_volume" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[7115b9cd-996e-4393-848a-dc8088bbcf5c]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" returned: 0 in 0.460s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" returned: 0 in 0.098s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:53 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd" released by "delete_volume" :: held 0.733s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['22276747-c697-4234-9e43-6504d530d57b', 'b41eef3f-93f9-45cd-b04f-b0858a945fc8', 'ef1a227a-700f-4fbd-9183-39b77822e35a', '888b15b3-35ef-44e5-9fe9-12c06f3e7c5c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.092s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-428732ac-5dea-4fa0-ab1c-25e47a5e85ec tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-b78e7f45-d4d4-4e2d-8acf-8bcb4841a6dd-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-29fff9f5-d059-42e9-8dec-72c45a7562ac-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-29fff9f5-d059-42e9-8dec-72c45a7562ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-29fff9f5-d059-42e9-8dec-72c45a7562ac" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-29fff9f5-d059-42e9-8dec-72c45a7562ac" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleting offline snapshot 29fff9f5-d059-42e9-8dec-72c45a7562ac of volume a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] snapshot_file for this snap is: volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e44b5c-d13c-47a5-afa5-4f5cf2bb3da8]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.397s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50edf94-7116-49f2-913d-22c56cc53de4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5b1b0-e07e-4b75-aa08-c90b5cacc74a]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4" returned: 0 in 0.419s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:56 devstack quobyte-client[82918]: System call of process 99971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.241s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4.29fff9f5-d059-42e9-8dec-72c45a7562ac" returned: 0 in 0.089s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-29fff9f5-d059-42e9-8dec-72c45a7562ac" released by "_delete_snapshot" :: held 1.476s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:56 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" released by "delete_snapshot" :: held 1.500s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['c6a9fd4b-cdba-499c-98f7-a1b4ba46153b', 'b915f56e-03e3-492e-b7ac-27f4a56ca551', '6394ead7-eaf3-49e0-a578-b23b00e3842c', '533ae809-bae7-4268-9c6d-b0d080be1b80'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:57 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Delete snapshot completed successfully.
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-a3865700-9585-4215-bb55-3b458b15ecc7 tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-29fff9f5-d059-42e9-8dec-72c45a7562ac-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-a50edf94-7116-49f2-913d-22c56cc53de4-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-a50edf94-7116-49f2-913d-22c56cc53de4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:57 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" acquired by "delete_volume" :: waited 0.012s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f2ec6a-5e11-4aa8-9f64-2b948ebd0a43]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:52:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4" returned: 0 in 0.441s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a50edf94-7116-49f2-913d-22c56cc53de4" returned: 0 in 0.129s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-quobyte-a50edf94-7116-49f2-913d-22c56cc53de4" released by "delete_volume" :: held 0.756s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Created reservations ['988dccc0-4816-487c-a81e-89980977f1d5', '802b01ab-b124-4295-91b6-1e4006cd6918', 'e7989381-7872-41d4-9ec8-19fed044a34a', '3220dc27-46c3-4d77-ae9b-2904e3d3157b'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:52:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:52:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.088s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:52:59 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:52:59 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Deleted volume successfully.
Sep 10 17:52:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-d1b35350-aa53-4479-81d3-7e6c213bb07f tempest-CreateVolumesFromSnapshotTest-1033212478 None] Lock "cinder-a50edf94-7116-49f2-913d-22c56cc53de4-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.126s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:53:05 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Flow 'volume_create_manager' (eb878b84-10cd-427c-b822-6db17cdcb3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cdd7eb-0e63-4948-a02a-b7c81318e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cdd7eb-0e63-4948-a02a-b7c81318e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820ca16333f54938995576853ade898f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:06Z,use_quota=True,user_id='f7ec08e760564fed96cc26e05f482092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391216f9-1cae-42d6-9afd-53797216ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391216f9-1cae-42d6-9afd-53797216ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b872f374-f17a-4afe-8443-f1343593a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b872f374-f17a-4afe-8443-f1343593a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93', 'volume_name': 'volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93', 'volume_size': 1, 'image_id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ea9aca7ffa0f7513e9a721026fc5852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820ca16333f54938995576853ade898f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f00cd710043a7302f9caa16c1ee9d418a9872ee1104a3bbcfe557416d3d4a68c17599f5bad7d6cf089f86328742a85024296887c336ef23e2bb6f2d54ae2a3a', 'id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'created_at': datetime.datetime(2025, 9, 10, 15, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 53, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bdb8d93-164d-4d4b-9d60-623efc0bee75/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398552d70>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01a72cf-4a91-4e9d-a968-152b7a49acab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01a72cf-4a91-4e9d-a968-152b7a49acab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac098323-878f-4fc6-b9db-42e9b45d4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93', 'volume_size': 1, 'image_id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ea9aca7ffa0f7513e9a721026fc5852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820ca16333f54938995576853ade898f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f00cd710043a7302f9caa16c1ee9d418a9872ee1104a3bbcfe557416d3d4a68c17599f5bad7d6cf089f86328742a85024296887c336ef23e2bb6f2d54ae2a3a', 'id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'created_at': datetime.datetime(2025, 9, 10, 15, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 53, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bdb8d93-164d-4d4b-9d60-623efc0bee75/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398552d70>}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Cloning 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 from image 6bdb8d93-164d-4d4b-9d60-623efc0bee75  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:53:06 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1aaed0-7272-4a5e-ae70-e3c88ea29f49]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:06 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD
Sep 10 17:53:06 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:53:08 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Sep 10 17:53:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 0 in 2.068s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:08 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD
Sep 10 17:53:08 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:53:10 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Sep 10 17:53:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 1 in 1.982s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:10 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Temporary image 6bdb8d93-164d-4d4b-9d60-623efc0bee75 is fetched for user f7ec08e760564fed96cc26e05f482092. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:53:10 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1fae9-298b-4f3c-990b-76c6de734874]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:11 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD
Sep 10 17:53:11 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:53:12 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Sep 10 17:53:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 0 in 2.056s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:13 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD
Sep 10 17:53:13 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:53:14 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Sep 10 17:53:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 1 in 1.995s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820ca16333f54938995576853ade898f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:06Z,use_quota=True,user_id='f7ec08e760564fed96cc26e05f482092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Creating volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:15 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:15 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=145, name=volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 1073741824" returned: 0 in 0.366s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 0 in 0.086s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Attempting download of 6bdb8d93-164d-4d4b-9d60-623efc0bee75 ((None, None)) to volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b361bda-94a1-408c-b3e3-7805cbd592f4]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bdb8d93-164d-4d4b-9d60-623efc0bee75_4hj6y4tg {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bdb8d93-164d-4d4b-9d60-623efc0bee75_4hj6y4tg" returned: 0 in 0.374s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bdb8d93-164d-4d4b-9d60-623efc0bee75_4hj6y4tg {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bdb8d93-164d-4d4b-9d60-623efc0bee75_4hj6y4tg" returned: 1 in 0.436s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bdb8d93-164d-4d4b-9d60-623efc0bee75_4hj6y4tg' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d532d-4ee1-4e44-be8f-1212fda97d80]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] 6bdb8d93-164d-4d4b-9d60-623efc0bee75 was raw, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:53:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:17 devstack quobyte-client[82918]: System call of process 100053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:18 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=145, name=volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 0 in 0.173s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6bdb8d93-164d-4d4b-9d60-623efc0bee75_x0ylyrj3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:53:18 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 1G" returned: 0 in 0.135s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[65489e42-ffb9-4676-a5f6-1d63242a4c51]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 0 in 0.427s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 1 in 0.389s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Downloaded image 6bdb8d93-164d-4d4b-9d60-623efc0bee75 ((None, None)) to volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Temporary image 6bdb8d93-164d-4d4b-9d60-623efc0bee75 for user f7ec08e760564fed96cc26e05f482092 is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Marking volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Copying metadata from image 6bdb8d93-164d-4d4b-9d60-623efc0bee75 to 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Creating volume glance metadata for volume 3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 backed by image 6bdb8d93-164d-4d4b-9d60-623efc0bee75 with: {'image_id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1ea9aca7ffa0f7513e9a721026fc5852', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac098323-878f-4fc6-b9db-42e9b45d4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93', 'volume_size': 1, 'image_id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ea9aca7ffa0f7513e9a721026fc5852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '820ca16333f54938995576853ade898f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f00cd710043a7302f9caa16c1ee9d418a9872ee1104a3bbcfe557416d3d4a68c17599f5bad7d6cf089f86328742a85024296887c336ef23e2bb6f2d54ae2a3a', 'id': '6bdb8d93-164d-4d4b-9d60-623efc0bee75', 'created_at': datetime.datetime(2025, 9, 10, 15, 53, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 53, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bdb8d93-164d-4d4b-9d60-623efc0bee75/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0398552d70>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b61bb60-aad6-48cc-99b3-d95f187b3bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:19 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Volume volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 (3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93): created successfully
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b61bb60-aad6-48cc-99b3-d95f187b3bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:19 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Flow 'volume_create_manager' (eb878b84-10cd-427c-b822-6db17cdcb3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-dde215ed-ea1f-4ba0-9db6-4e1abd036b51 tempest-VolumeImageDependencyTests-1599562484 None] Created volume successfully.
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Acquiring lock "cinder-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "cinder-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:53:21 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Acquiring lock "cinder-quobyte-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "cinder-quobyte-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" acquired by "delete_volume" :: waited 0.011s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcf66af-2927-4af7-a8bb-a0d05ecf8eb9]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 0 in 0.399s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 1 in 0.387s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" returned: 0 in 0.118s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "cinder-quobyte-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93" released by "delete_volume" :: held 1.155s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Created reservations ['ccd7b1df-21ac-4cac-be62-d470f23708d4', '873d6444-510b-425b-ba59-5de731d7a885', '77688eca-705a-4483-87af-6f94c0bc3e5e', '4edd799a-3b42-4f36-bbb1-c5bd931e88eb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.102s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:23 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:53:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Deleted volume successfully.
Sep 10 17:53:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e8bad3f9-bf7e-428a-b44e-19852dc936e1 tempest-VolumeImageDependencyTests-1599562484 None] Lock "cinder-3e74e4b1-cdc2-49cf-86a5-ab5c1c10db93-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:53:32 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=55,cinder:UPDATE=83,cinder:DELETE=9,cinder:INSERT=17 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:53:33 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=74,cinder:SELECT=53,cinder:DELETE=6,cinder:INSERT=24 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:53:43 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:43 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (7b5384e7-df29-4e8f-b092-40538c92ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:43 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8771e-bd73-4f84-a6bf-e72c40ab3858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a8771e-bd73-4f84-a6bf-e72c40ab3858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228726639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836320ab-8c22-4557-8b50-21960d0f9fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:44Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202b18f-b070-43fa-93d0-0c415b1c839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1202b18f-b070-43fa-93d0-0c415b1c839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d12657-b612-4570-9242-143eb3e16e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d12657-b612-4570-9242-143eb3e16e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836320ab-8c22-4557-8b50-21960d0f9fb6', 'volume_name': 'volume-836320ab-8c22-4557-8b50-21960d0f9fb6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26465dcc-f54b-41e5-b8fa-f490dfdcae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26465dcc-f54b-41e5-b8fa-f490dfdcae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8a808d-4083-4586-a21a-a0e07b5f2e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:44 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume 836320ab-8c22-4557-8b50-21960d0f9fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836320ab-8c22-4557-8b50-21960d0f9fb6', 'volume_size': 1}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-228726639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836320ab-8c22-4557-8b50-21960d0f9fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:44Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume 836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:44 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:44 devstack quobyte-client[82918]: System call of process 100122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:44 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=146, name=volume-836320ab-8c22-4557-8b50-21960d0f9fb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (94d7e08c-cac9-4614-a906-998051b42216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7bd704-e445-4975-a212-efb4f6a1b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7bd704-e445-4975-a212-efb4f6a1b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262477603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0828fbb7-4031-41b2-9fb0-d54133f8b4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:44Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07510008-2132-4648-91bd-419e99f53b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07510008-2132-4648-91bd-419e99f53b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef060b5d-87cd-4666-a96c-5ef62c7d007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef060b5d-87cd-4666-a96c-5ef62c7d007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0828fbb7-4031-41b2-9fb0-d54133f8b4e6', 'volume_name': 'volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7e81f-e9b9-45bd-990c-fff7f2563e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7e81f-e9b9-45bd-990c-fff7f2563e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8596ecfe-f86e-45fa-bc08-6be249f5c386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:45 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Volume 0828fbb7-4031-41b2-9fb0-d54133f8b4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6', 'volume_size': 1}
Sep 10 17:53:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 1073741824" returned: 0 in 1.958s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:46 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:46 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:46 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (468896c9-9818-4376-b173-9936962ae5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf7a073-3668-487d-92bb-fbcd139738ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6" returned: 0 in 1.427s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (3445ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.481s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262477603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0828fbb7-4031-41b2-9fb0-d54133f8b4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:44Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Creating volume 0828fbb7-4031-41b2-9fb0-d54133f8b4e6 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:47 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:47 devstack quobyte-client[82918]: System call of process 100127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf7a073-3668-487d-92bb-fbcd139738ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653202176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82627177-143f-416c-b8f5-48d59929045e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:46Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:47 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=147, name=volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:47 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3efd560-df3c-4bd6-8e56-56810886599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3efd560-df3c-4bd6-8e56-56810886599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f443ce3-e0e9-4223-b94c-30e640581856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f443ce3-e0e9-4223-b94c-30e640581856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82627177-143f-416c-b8f5-48d59929045e', 'volume_name': 'volume-82627177-143f-416c-b8f5-48d59929045e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff19560-ba05-4503-b0e3-97a817de2596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff19560-ba05-4503-b0e3-97a817de2596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50fb458-8881-42e2-85fb-948b0f4a8cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Volume 82627177-143f-416c-b8f5-48d59929045e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82627177-143f-416c-b8f5-48d59929045e', 'volume_size': 1}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8a808d-4083-4586-a21a-a0e07b5f2e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836320ab-8c22-4557-8b50-21960d0f9fb6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3063b9fc-19ae-4d12-828c-abbb2756288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (0fc0a54c-583d-4bb2-8784-8a6adf5a837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80ebdd7-369a-4046-bfa8-bd48e35210bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 1073741824" returned: 0 in 0.915s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:48 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (2affb68c-fc39-46d3-aa92-d6ff91f4ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d34d3fe-e7d2-4245-b17c-3c4db57ac6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80ebdd7-369a-4046-bfa8-bd48e35210bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698640746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75d3046-b26d-4309-8484-cea5cad2dc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:46Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10567d8c-c08e-4110-b31c-bc169d8f9c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10567d8c-c08e-4110-b31c-bc169d8f9c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df43677-8039-4cf6-81bd-fa45f25e8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df43677-8039-4cf6-81bd-fa45f25e8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75d3046-b26d-4309-8484-cea5cad2dc20', 'volume_name': 'volume-a75d3046-b26d-4309-8484-cea5cad2dc20', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8feb2c7-85db-445c-8db9-0e86452f7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8feb2c7-85db-445c-8db9-0e86452f7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02920e99-f350-44fd-809a-c864fcf0a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Volume a75d3046-b26d-4309-8484-cea5cad2dc20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75d3046-b26d-4309-8484-cea5cad2dc20', 'volume_size': 1}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:49 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-836320ab-8c22-4557-8b50-21960d0f9fb6 (836320ab-8c22-4557-8b50-21960d0f9fb6): created successfully
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3063b9fc-19ae-4d12-828c-abbb2756288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (7b5384e7-df29-4e8f-b092-40538c92ee61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" returned: 0 in 1.055s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] <== create_volume: return (2001ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d34d3fe-e7d2-4245-b17c-3c4db57ac6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024438558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb22656-f122-4193-978e-e83e0a2a8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:47Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e736f190-3164-4377-9cc7-88df73a5bf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e736f190-3164-4377-9cc7-88df73a5bf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82efdd6-0d78-4934-913e-03f2d4238a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82efdd6-0d78-4934-913e-03f2d4238a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb22656-f122-4193-978e-e83e0a2a8026', 'volume_name': 'volume-beb22656-f122-4193-978e-e83e0a2a8026', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879df7a1-bbce-4229-9187-cff84c4ffa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879df7a1-bbce-4229-9187-cff84c4ffa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27347e6b-5306-46c6-8768-c713a43d14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:49 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Volume beb22656-f122-4193-978e-e83e0a2a8026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb22656-f122-4193-978e-e83e0a2a8026', 'volume_size': 1}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024438558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb22656-f122-4193-978e-e83e0a2a8026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:47Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Creating volume beb22656-f122-4193-978e-e83e0a2a8026 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:49 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:49 devstack quobyte-client[82918]: System call of process 100132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-09259e8d-dc61-4289-b653-9f066475c303 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:53:49 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=148, name=volume-beb22656-f122-4193-978e-e83e0a2a8026, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (5dbed917-d0bd-43c2-8c94-c8a139d0c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166d108-38d8-4b87-9e49-c77f158e533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8596ecfe-f86e-45fa-bc08-6be249f5c386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621467b-b6a6-4468-954b-ec47f61f0172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026 1073741824" returned: 0 in 0.867s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166d108-38d8-4b87-9e49-c77f158e533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341691141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80555f16-f9e8-49c9-9479-fd3a96611c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:49Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b4aabd-4a36-4eb8-af1d-2a278028a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b4aabd-4a36-4eb8-af1d-2a278028a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873f4912-3cfd-49b3-b5a5-b9c938505f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873f4912-3cfd-49b3-b5a5-b9c938505f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80555f16-f9e8-49c9-9479-fd3a96611c5c', 'volume_name': 'volume-80555f16-f9e8-49c9-9479-fd3a96611c5c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbae75-dc52-4a62-b77b-5817d18b1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbae75-dc52-4a62-b77b-5817d18b1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9696e29-ca6a-46f5-aa21-d40a61f4c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Volume 80555f16-f9e8-49c9-9479-fd3a96611c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80555f16-f9e8-49c9-9479-fd3a96611c5c', 'volume_size': 1}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Volume volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 (0828fbb7-4031-41b2-9fb0-d54133f8b4e6): created successfully
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621467b-b6a6-4468-954b-ec47f61f0172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (94d7e08c-cac9-4614-a906-998051b42216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026" returned: 0 in 0.386s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] <== create_volume: return (1315ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698640746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75d3046-b26d-4309-8484-cea5cad2dc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:46Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Creating volume a75d3046-b26d-4309-8484-cea5cad2dc20 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:51 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:51 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=149, name=volume-a75d3046-b26d-4309-8484-cea5cad2dc20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:51 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b65c1097-5e51-45e5-9ddf-0868c60e8667 tempest-CreateVolumesFromImageTest-1074493915 None] Created volume successfully.
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27347e6b-5306-46c6-8768-c713a43d14a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb22656-f122-4193-978e-e83e0a2a8026', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0f5316-a9e0-454a-95b3-e75959aa9a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:51 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Volume volume-beb22656-f122-4193-978e-e83e0a2a8026 (beb22656-f122-4193-978e-e83e0a2a8026): created successfully
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0f5316-a9e0-454a-95b3-e75959aa9a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (2affb68c-fc39-46d3-aa92-d6ff91f4ef10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20 1073741824" returned: 0 in 0.651s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20" returned: 0 in 0.190s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] <== create_volume: return (899ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.968s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1653202176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82627177-143f-416c-b8f5-48d59929045e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:46Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Creating volume 82627177-143f-416c-b8f5-48d59929045e {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:52 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:52 devstack quobyte-client[82918]: System call of process 100140 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:52 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=150, name=volume-82627177-143f-416c-b8f5-48d59929045e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a441c8fc-04d2-4117-b10d-ffa6593fc805 tempest-CreateVolumesFromImageTest-1074493915 None] Created volume successfully.
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02920e99-f350-44fd-809a-c864fcf0a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75d3046-b26d-4309-8484-cea5cad2dc20', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477e435b-5f84-49b0-beea-3b90657618fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:52 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Volume volume-a75d3046-b26d-4309-8484-cea5cad2dc20 (a75d3046-b26d-4309-8484-cea5cad2dc20): created successfully
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477e435b-5f84-49b0-beea-3b90657618fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (0fc0a54c-583d-4bb2-8784-8a6adf5a837f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0afd0f65-9185-40e5-8ee9-2dd829187760 tempest-CreateVolumesFromImageTest-1074493915 None] Created volume successfully.
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e 1073741824" returned: 0 in 0.694s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e" returned: 0 in 0.171s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] <== create_volume: return (923ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.560s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating offline snapshot 41c7a553-0f09-48d3-a54c-486a8e60e420 of volume 836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50fb458-8881-42e2-85fb-948b0f4a8cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82627177-143f-416c-b8f5-48d59929045e', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed76ac2-eab5-46ae-af12-9769353f3f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873ce06-351a-4081-b22b-d004178de357]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:53 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Volume volume-82627177-143f-416c-b8f5-48d59929045e (82627177-143f-416c-b8f5-48d59929045e): created successfully
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed76ac2-eab5-46ae-af12-9769353f3f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (468896c9-9818-4376-b173-9936962ae5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-10cab4be-ab6c-44eb-87fb-8e42715d41cf tempest-CreateVolumesFromImageTest-1074493915 None] Created volume successfully.
Sep 10 17:53:54 devstack quobyte-client[82918]: System call of process 100144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6" returned: 0 in 0.688s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:54 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=151, name=volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 1G" returned: 0 in 0.446s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img rebase -u -b volume-836320ab-8c22-4557-8b50-21960d0f9fb6 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img rebase -u -b volume-836320ab-8c22-4557-8b50-21960d0f9fb6 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.275s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.129s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.121s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.info" returned: 0 in 0.113s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.info" returned: 0 in 0.110s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.427s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341691141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80555f16-f9e8-49c9-9479-fd3a96611c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3d998add0bb4c08be8f153e2627c6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:49Z,use_quota=True,user_id='7d85ee0ee20740da827e9bf978966b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Creating volume 80555f16-f9e8-49c9-9479-fd3a96611c5c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:56 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:56 devstack quobyte-client[82918]: System call of process 100157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:53:56 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=153, name=volume-80555f16-f9e8-49c9-9479-fd3a96611c5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:56 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-88b9bf30-1552-4de8-87c0-5002c4589796 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Create snapshot completed successfully
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c 1073741824" returned: 0 in 0.496s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c" returned: 0 in 0.211s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:53:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9696e29-ca6a-46f5-aa21-d40a61f4c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80555f16-f9e8-49c9-9479-fd3a96611c5c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f643615d-4114-4b2d-b903-c6c01926bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Volume volume-80555f16-f9e8-49c9-9479-fd3a96611c5c (80555f16-f9e8-49c9-9479-fd3a96611c5c): created successfully
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f643615d-4114-4b2d-b903-c6c01926bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Flow 'volume_create_manager' (5dbed917-d0bd-43c2-8c94-c8a139d0c16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:57 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-9b6b4269-6ff0-4b2c-8c24-530d252a0988 tempest-CreateVolumesFromImageTest-1074493915 None] Created volume successfully.
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-80555f16-f9e8-49c9-9479-fd3a96611c5c-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:53:57 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-80555f16-f9e8-49c9-9479-fd3a96611c5c-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:53:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-quobyte-80555f16-f9e8-49c9-9479-fd3a96611c5c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:53:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (bafceadf-345f-41af-be40-1d8665f7a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510dfc00-85f3-47cb-9a16-000225a7ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510dfc00-85f3-47cb-9a16-000225a7ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1039912311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de5ef47-231d-4b62-85cc-4b7b10012118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee7e12e-2aac-458f-8327-13df4bf66dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee7e12e-2aac-458f-8327-13df4bf66dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a2184-0bfd-4eff-9e67-ea435536037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720a2184-0bfd-4eff-9e67-ea435536037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de5ef47-231d-4b62-85cc-4b7b10012118', 'volume_name': 'volume-5de5ef47-231d-4b62-85cc-4b7b10012118', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ca7448-4a3b-4ac9-bd7e-0c57665611d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ca7448-4a3b-4ac9-bd7e-0c57665611d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34634334-7ce2-4779-a43e-1e4fd16aadb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:53:58 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume 5de5ef47-231d-4b62-85cc-4b7b10012118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de5ef47-231d-4b62-85cc-4b7b10012118', 'volume_size': 1}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1039912311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de5ef47-231d-4b62-85cc-4b7b10012118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume 5de5ef47-231d-4b62-85cc-4b7b10012118 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:53:58 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:53:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:53:58 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=154, name=volume-5de5ef47-231d-4b62-85cc-4b7b10012118, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:53:59 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-80555f16-f9e8-49c9-9479-fd3a96611c5c" acquired by "delete_volume" :: waited 1.452s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:53:59 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[900fd347-e05f-4421-b9dc-65a86e93160d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:53:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (1901edff-4047-43ea-8691-f3b5676e8286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6519e8-70eb-47b5-8a08-298af5898cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (feaec605-618e-4e66-a55f-c18eaeabca07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28df4a53-e58a-42e5-b1c4-2790d5ac9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (a52a11d2-e02c-49d8-9b8d-047a8bc64d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e979de2c-c77f-491b-8b06-c9653f894e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118 1073741824" returned: 0 in 2.569s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28df4a53-e58a-42e5-b1c4-2790d5ac9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856557780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590ca02-a892-4c1e-af6f-5a97e5003e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa895ed-598a-4547-bba3-88bf5f6d02db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa895ed-598a-4547-bba3-88bf5f6d02db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac5686b-2ad0-4260-8b75-3cac63d6ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac5686b-2ad0-4260-8b75-3cac63d6ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4590ca02-a892-4c1e-af6f-5a97e5003e43', 'volume_name': 'volume-4590ca02-a892-4c1e-af6f-5a97e5003e43', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d973c3bb-e3f1-42c5-9c36-cc761173b219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d973c3bb-e3f1-42c5-9c36-cc761173b219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15823ab3-89c2-4845-b07e-fe9839286f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume 4590ca02-a892-4c1e-af6f-5a97e5003e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4590ca02-a892-4c1e-af6f-5a97e5003e43', 'volume_size': 1}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6519e8-70eb-47b5-8a08-298af5898cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777510631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2747904d-d667-41bb-98d1-d2fd39fc6fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:59Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9720d-60c6-4ec6-b433-5db53e663aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9720d-60c6-4ec6-b433-5db53e663aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910d38d-ca26-4b10-a172-354db6f1f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910d38d-ca26-4b10-a172-354db6f1f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2747904d-d667-41bb-98d1-d2fd39fc6fb4', 'volume_name': 'volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b338b12-0630-43ef-aafe-1e5c1c269ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b338b12-0630-43ef-aafe-1e5c1c269ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc62a85-846f-4bb8-aa4f-978f32c38ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume 2747904d-d667-41bb-98d1-d2fd39fc6fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4', 'volume_size': 1}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c" returned: 0 in 1.714s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e979de2c-c77f-491b-8b06-c9653f894e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723333490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:00Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16fb0c5-91da-4f22-b515-433a35121f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16fb0c5-91da-4f22-b515-433a35121f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716f7f7-0d54-430b-b7d6-950da9b8be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716f7f7-0d54-430b-b7d6-950da9b8be06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd', 'volume_name': 'volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e4992-d056-4339-add9-96ac01f89d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e4992-d056-4339-add9-96ac01f89d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06037246-a284-4a26-a651-950942d31efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:01 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume 7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd', 'volume_size': 1}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118" returned: 0 in 0.850s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (3539ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.548s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.957s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1856557780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4590ca02-a892-4c1e-af6f-5a97e5003e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:58Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume 4590ca02-a892-4c1e-af6f-5a97e5003e43 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:01 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:02 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:02 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=155, name=volume-4590ca02-a892-4c1e-af6f-5a97e5003e43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (f2338918-6633-4f49-a836-21a063bb9c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5936dfa-d570-4707-a048-ee1869b3aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-80555f16-f9e8-49c9-9479-fd3a96611c5c" returned: 0 in 1.112s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34634334-7ce2-4779-a43e-1e4fd16aadb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de5ef47-231d-4b62-85cc-4b7b10012118', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45948959-00fc-49d2-970f-ba4b492a0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5936dfa-d570-4707-a048-ee1869b3aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040021096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cc021d-c495-42db-9129-9dbae1af1b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:01Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b783dc-4389-4c52-980f-78c71fdafabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b783dc-4389-4c52-980f-78c71fdafabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58aeda6-028c-4488-baf5-3e95223c0f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58aeda6-028c-4488-baf5-3e95223c0f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cc021d-c495-42db-9129-9dbae1af1b5c', 'volume_name': 'volume-a9cc021d-c495-42db-9129-9dbae1af1b5c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28f2467-6290-4ef5-a22d-3a0c562f55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28f2467-6290-4ef5-a22d-3a0c562f55b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3873d66-87c9-4574-b1c4-98a2bebcc284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume a9cc021d-c495-42db-9129-9dbae1af1b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cc021d-c495-42db-9129-9dbae1af1b5c', 'volume_size': 1}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-80555f16-f9e8-49c9-9479-fd3a96611c5c" released by "delete_volume" :: held 3.278s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:02 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-5de5ef47-231d-4b62-85cc-4b7b10012118 (5de5ef47-231d-4b62-85cc-4b7b10012118): created successfully
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45948959-00fc-49d2-970f-ba4b492a0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (bafceadf-345f-41af-be40-1d8665f7a227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 1073741824" returned: 0 in 0.891s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:03 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8c85f7e8-8441-49c2-8658-fa788fe4420c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43" returned: 0 in 0.717s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (1679ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.679s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777510631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2747904d-d667-41bb-98d1-d2fd39fc6fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:53:59Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume 2747904d-d667-41bb-98d1-d2fd39fc6fb4 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:03 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:03 devstack quobyte-client[82918]: System call of process 100176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:03 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=156, name=volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.861s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15823ab3-89c2-4845-b07e-fe9839286f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4590ca02-a892-4c1e-af6f-5a97e5003e43', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dde4b1a-635f-4e78-a1fb-e255b822ec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:04 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 (4590ca02-a892-4c1e-af6f-5a97e5003e43): created successfully
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dde4b1a-635f-4e78-a1fb-e255b822ec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (feaec605-618e-4e66-a55f-c18eaeabca07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 1073741824" returned: 0 in 0.630s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e83cbf99-6afd-487e-8f97-1dbf12349672 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Created reservations ['8710f852-444c-46de-b2cc-b1b46b2671a2', '56d05fb4-88d7-4a56-9c2a-8c1012f76fbf', '6fb7d05a-f60a-4680-88a4-dcf27a6a1a03', '8951c6b5-5e9a-4ec5-89b0-0747bf901c96'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4" returned: 0 in 0.365s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (1024ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723333490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:00Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume 7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:04 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:04 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=157, name=volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc62a85-846f-4bb8-aa4f-978f32c38ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffd35f8-2815-4a3a-8fbe-592c84c73489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd 1073741824" returned: 0 in 0.614s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:05 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 (2747904d-d667-41bb-98d1-d2fd39fc6fb4): created successfully
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffd35f8-2815-4a3a-8fbe-592c84c73489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (1901edff-4047-43ea-8691-f3b5676e8286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" returned: 0 in 0.464s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (1113ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040021096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cc021d-c495-42db-9129-9dbae1af1b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91d00feb98148399cd99f02bd967944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:01Z,use_quota=True,user_id='fb397c09b855434b8bbf9700032778c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Creating volume a9cc021d-c495-42db-9129-9dbae1af1b5c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:05 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-a455ca92-2f91-447e-aec0-f18b90c5036c tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:54:06 devstack quobyte-client[82918]: System call of process 100184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:06 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=158, name=volume-a9cc021d-c495-42db-9129-9dbae1af1b5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-beb22656-f122-4193-978e-e83e0a2a8026-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06037246-a284-4a26-a651-950942d31efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6426b2c-e6ca-452d-98ca-ba90e964cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c 1073741824" returned: 0 in 0.792s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-beb22656-f122-4193-978e-e83e0a2a8026-delete_volume" acquired by "delete_volume" :: waited 0.310s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd (7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd): created successfully
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6426b2c-e6ca-452d-98ca-ba90e964cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (a52a11d2-e02c-49d8-9b8d-047a8bc64d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:07 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-quobyte-beb22656-f122-4193-978e-e83e0a2a8026" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c" returned: 0 in 1.062s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] <== create_volume: return (1911ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:07 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-2869c6da-759d-49ed-ac5c-7c043e5eefe4 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3873d66-87c9-4574-b1c4-98a2bebcc284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cc021d-c495-42db-9129-9dbae1af1b5c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee67d24-36b9-41f2-8d8d-55b871ae5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-beb22656-f122-4193-978e-e83e0a2a8026" acquired by "delete_volume" :: waited 0.313s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.638s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd94d6b-56a4-4131-9117-0e61f271e5b5]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:08 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume volume-a9cc021d-c495-42db-9129-9dbae1af1b5c (a9cc021d-c495-42db-9129-9dbae1af1b5c): created successfully
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee67d24-36b9-41f2-8d8d-55b871ae5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Flow 'volume_create_manager' (f2338918-6633-4f49-a836-21a063bb9c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Deleted volume successfully.
Sep 10 17:54:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4ab0a177-83e2-4ef9-9327-cc2898dd6b19 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created volume successfully.
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-7a3b07b0-86f1-4a2d-8026-5849e8ad4700 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-80555f16-f9e8-49c9-9479-fd3a96611c5c-delete_volume" released by "delete_volume" :: held 10.638s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026" returned: 0 in 0.738s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-a9cc021d-c495-42db-9129-9dbae1af1b5c-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-beb22656-f122-4193-978e-e83e0a2a8026" returned: 0 in 0.475s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-a9cc021d-c495-42db-9129-9dbae1af1b5c-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-beb22656-f122-4193-978e-e83e0a2a8026" released by "delete_volume" :: held 1.495s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:09 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-a9cc021d-c495-42db-9129-9dbae1af1b5c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-a9cc021d-c495-42db-9129-9dbae1af1b5c" acquired by "delete_volume" :: waited 0.043s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5048f6d-7f65-462e-8f0a-6f0fc2b6ee64]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:09 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Created reservations ['a1164af4-b53a-45ab-9895-48ca5e904994', '3637a550-e0d1-4111-8a59-c626e36a1836', '9b43556f-99af-4b58-8c7a-e43a74d65859', 'c0eb8b0d-6bbe-42f2-a717-017164b7cc03'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c" returned: 0 in 0.804s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.313s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:10 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:10 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Deleted volume successfully.
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-a75d3046-b26d-4309-8484-cea5cad2dc20-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a9cc021d-c495-42db-9129-9dbae1af1b5c" returned: 0 in 0.517s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-699f9758-b3eb-4c53-9b25-b4d61aa3785e tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-beb22656-f122-4193-978e-e83e0a2a8026-delete_volume" released by "delete_volume" :: held 4.370s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-a9cc021d-c495-42db-9129-9dbae1af1b5c" released by "delete_volume" :: held 1.485s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-a75d3046-b26d-4309-8484-cea5cad2dc20-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-quobyte-a75d3046-b26d-4309-8484-cea5cad2dc20" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-a75d3046-b26d-4309-8484-cea5cad2dc20" acquired by "delete_volume" :: waited 0.041s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['4fad44c6-5287-494a-abd1-8f2c2782164f', 'a805b1f9-0e4d-4b2d-8994-77956d8c929c', '2c5a5a19-3c8d-4795-8b99-05d446101e21', 'a83c66f3-555e-4a4e-b9d8-4a4da7b55d09'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec02cab-78b2-489e-92e3-8587a93a90d7]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.057s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20" returned: 0 in 0.736s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.231s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a75d3046-b26d-4309-8484-cea5cad2dc20" returned: 0 in 0.578s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-211eb1d5-7765-4384-b873-de169e40f4b7 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-a9cc021d-c495-42db-9129-9dbae1af1b5c-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:12 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-a75d3046-b26d-4309-8484-cea5cad2dc20" released by "delete_volume" :: held 1.479s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" acquired by "delete_volume" :: waited 0.034s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Created reservations ['58fb1cb7-0511-4e9b-b8b1-9d1d7ffac0f9', '2f433bb1-f925-4346-a20d-dcbaadc77137', '377eccb6-5200-409c-8f47-7644fc548757', '7749f80b-c36c-4dbf-a70c-55348c737aa0'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b9718-dfd3-406d-ba01-249ffecc9559]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.042s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.224s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:14 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Deleted volume successfully.
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" returned: 0 in 1.172s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-82627177-143f-416c-b8f5-48d59929045e-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-f5d219dc-10cf-4b71-b6d9-912c50158f26 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-a75d3046-b26d-4309-8484-cea5cad2dc20-delete_volume" released by "delete_volume" :: held 3.700s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" returned: 0 in 0.501s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd" released by "delete_volume" :: held 1.793s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-82627177-143f-416c-b8f5-48d59929045e-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:15 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-quobyte-82627177-143f-416c-b8f5-48d59929045e" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-82627177-143f-416c-b8f5-48d59929045e" acquired by "delete_volume" :: waited 0.082s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b698cf9d-2d16-4600-9bd6-10943fba1116]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:15 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['9a9bf687-d04e-4a67-9c68-1ccc6a0d89c5', '65067111-86e9-4bf5-86b6-4fa0a5aad924', 'c05aaae8-28bc-4044-b170-44da2fd7ae03', '5b0c2dc9-96fa-4de1-af45-2dca0654cea7'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e" returned: 0 in 0.763s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-82627177-143f-416c-b8f5-48d59929045e" returned: 0 in 0.406s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-82627177-143f-416c-b8f5-48d59929045e" released by "delete_volume" :: held 1.313s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Created reservations ['8d60434c-f2d9-44df-a635-60b020fb3441', 'd6e07461-78a1-415c-a535-299291696838', '4c63dc46-eacd-4136-aed0-a094296c685d', '27572199-73a2-4ad4-86be-adbaba830bf7'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-2747904d-d667-41bb-98d1-d2fd39fc6fb4-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.640s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-2747904d-d667-41bb-98d1-d2fd39fc6fb4-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-49c34c34-d23d-4a0e-ad28-bbaee45d9a46 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-7bd113af-bb8c-45ca-8ff5-2f6f48ebb6bd-delete_volume" released by "delete_volume" :: held 4.628s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:18 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-2747904d-d667-41bb-98d1-d2fd39fc6fb4" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-2747904d-d667-41bb-98d1-d2fd39fc6fb4" acquired by "delete_volume" :: waited 0.222s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.640s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8d91f-3223-4393-8746-5ef853e0b45d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-0828fbb7-4031-41b2-9fb0-d54133f8b4e6-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:19 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Deleted volume successfully.
Sep 10 17:54:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-0828fbb7-4031-41b2-9fb0-d54133f8b4e6-delete_volume" acquired by "delete_volume" :: waited 0.949s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c0db724c-381f-48f9-b70f-6e4a4a3df899 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-82627177-143f-416c-b8f5-48d59929045e-delete_volume" released by "delete_volume" :: held 4.733s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "cinder-quobyte-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4" returned: 0 in 1.358s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" acquired by "delete_volume" :: waited 0.277s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-2747904d-d667-41bb-98d1-d2fd39fc6fb4" returned: 0 in 0.331s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd2b5a-cda2-4f99-8f68-8c7954458b6e]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-2747904d-d667-41bb-98d1-d2fd39fc6fb4" released by "delete_volume" :: held 2.253s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:21 devstack quobyte-client[82918]: System call of process 100261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" returned: 0 in 0.939s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" returned: 0 in 0.260s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-quobyte-0828fbb7-4031-41b2-9fb0-d54133f8b4e6" released by "delete_volume" :: held 1.424s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:21 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['2b2095a3-3e4d-46d8-a315-af31350a1b09', '0c690809-d8a6-4770-be0a-05fa9919adf9', 'c14611b6-6353-445e-bbe3-62d1429289cd', '1d4413b3-5aa5-4c84-abfd-ab91723edf3e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Created reservations ['269eb8b1-76e5-4dbd-923a-292b43de5597', 'c2f01755-3769-4040-b0dd-6d84211446d7', '44c43408-a855-4802-ae58-6924bf96c053', '4e8fdad4-d633-429e-8252-ff4adfeaa877'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.273s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-94ef760f-2aa6-4087-8cd0-50c609114544 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-2747904d-d667-41bb-98d1-d2fd39fc6fb4-delete_volume" released by "delete_volume" :: held 5.556s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.513s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:23 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Deleted volume successfully.
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4079f8fa-97cc-40db-94e1-57deece5fa28 tempest-CreateVolumesFromImageTest-1074493915 None] Lock "cinder-0828fbb7-4031-41b2-9fb0-d54133f8b4e6-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-4590ca02-a892-4c1e-af6f-5a97e5003e43-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-4590ca02-a892-4c1e-af6f-5a97e5003e43-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:23 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-4590ca02-a892-4c1e-af6f-5a97e5003e43" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-4590ca02-a892-4c1e-af6f-5a97e5003e43" acquired by "delete_volume" :: waited 0.050s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecdeb40-526a-493e-8832-674f50ff4085]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:24 devstack quobyte-client[82918]: System call of process 100267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43" returned: 0 in 1.167s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-4590ca02-a892-4c1e-af6f-5a97e5003e43" returned: 0 in 0.241s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-4590ca02-a892-4c1e-af6f-5a97e5003e43" released by "delete_volume" :: held 1.845s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['8fb6eeff-47a5-4c94-90b3-80e44e6e8a49', '8c769494-7a5d-403f-bf3a-975c3f991f9a', '0d22232c-1247-4d0f-b319-2a26dbc7750a', '36ebf9a6-9a8f-403f-8b3a-92679e1f92eb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:26 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.189s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:27 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:27 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-5de5ef47-231d-4b62-85cc-4b7b10012118-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ab34bb5f-f38b-4c60-abe2-438182cc47a2 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-4590ca02-a892-4c1e-af6f-5a97e5003e43-delete_volume" released by "delete_volume" :: held 4.364s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-5de5ef47-231d-4b62-85cc-4b7b10012118-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:27 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Flow 'volume_create_manager' (1adeb96f-692d-49a1-98d1-51b7c36a98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b35cb1c-3057-402d-b05b-8d3ebd4e581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:28 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-5de5ef47-231d-4b62-85cc-4b7b10012118" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b35cb1c-3057-402d-b05b-8d3ebd4e581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1916921023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd9842d-1b92-49cd-a51b-4f5aae1730eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b626627bd6ce40d995ff0b8a2a0e9a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:27Z,use_quota=True,user_id='7f0b8858814246059226b22a7f5a2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8523683c-df46-4deb-8808-1f249aaebba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8523683c-df46-4deb-8808-1f249aaebba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be095b2-af54-4c6a-bc30-bdb2f13528b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be095b2-af54-4c6a-bc30-bdb2f13528b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd9842d-1b92-49cd-a51b-4f5aae1730eb', 'volume_name': 'volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709644ce-38a9-44b0-b125-b9733c814a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709644ce-38a9-44b0-b125-b9733c814a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa96585-dc26-4798-bd09-44740aa427bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:28 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Volume 1cd9842d-1b92-49cd-a51b-4f5aae1730eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb', 'volume_size': 1}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1916921023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd9842d-1b92-49cd-a51b-4f5aae1730eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b626627bd6ce40d995ff0b8a2a0e9a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:27Z,use_quota=True,user_id='7f0b8858814246059226b22a7f5a2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Creating volume 1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:28 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:28 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=159, name=volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-5de5ef47-231d-4b62-85cc-4b7b10012118" acquired by "delete_volume" :: waited 0.347s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a4ce2-da98-4950-81ab-ad42365936ec]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb 1073741824" returned: 0 in 0.681s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 0.200s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa96585-dc26-4798-bd09-44740aa427bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15589c82-a71c-4b26-87ac-a3f5a0dd2786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:29 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Volume volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb (1cd9842d-1b92-49cd-a51b-4f5aae1730eb): created successfully
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15589c82-a71c-4b26-87ac-a3f5a0dd2786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Flow 'volume_create_manager' (1adeb96f-692d-49a1-98d1-51b7c36a98c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:29 devstack quobyte-client[82918]: System call of process 100277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0c1c4cde-6910-46d8-897a-106fb11412d6 tempest-SnapshotDependencyTests-568918210 None] Created volume successfully.
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118" returned: 0 in 1.054s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-5de5ef47-231d-4b62-85cc-4b7b10012118" returned: 0 in 0.220s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-5de5ef47-231d-4b62-85cc-4b7b10012118" released by "delete_volume" :: held 1.627s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Creating offline snapshot d0bb38f9-8518-498e-82a6-e1e0a16efbfb of volume 1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['120341d3-09d9-423a-b236-4b2494f746d7', 'd37f5848-d28a-4636-bccd-8384ff055045', 'c6a231cd-328d-4b1d-9bde-03a806659e05', 'e96f73cc-af78-46bb-b0b8-08c37d052f9d'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b005c09-7286-4bcb-bbb7-caae8456f5ea]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:31 devstack quobyte-client[82918]: System call of process 100282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.045s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 1.026s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.302s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:32 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:32 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=160, name=volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb 1G" returned: 0 in 0.454s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-41c7a553-0f09-48d3-a54c-486a8e60e420-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "qemu-img rebase -u -b volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.311s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:32 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-43935cbc-e1bf-4705-9428-14a669039996 tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-5de5ef47-231d-4b62-85cc-4b7b10012118-delete_volume" released by "delete_volume" :: held 5.050s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-41c7a553-0f09-48d3-a54c-486a8e60e420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.400s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:33 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.313s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.191s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" acquired by "delete_snapshot" :: waited 0.354s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-41c7a553-0f09-48d3-a54c-486a8e60e420" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.info" returned: 0 in 0.473s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-41c7a553-0f09-48d3-a54c-486a8e60e420" acquired by "_delete_snapshot" :: waited 0.467s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleting offline snapshot 41c7a553-0f09-48d3-a54c-486a8e60e420 of volume 836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:54:33 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] snapshot_file for this snap is: volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc48b2b-9f80-484f-98fa-91edd2c3a014]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.info" returned: 0 in 0.344s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.444s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:34 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e9749515-06d7-447f-9519-b50d3583ce10 tempest-SnapshotDependencyTests-568918210 None] Create snapshot completed successfully
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.606s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836320ab-8c22-4557-8b50-21960d0f9fb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[20efc893-6d5b-4744-b93c-f39419963e44]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:34 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6" returned: 0 in 0.568s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.520s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:35 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Flow 'volume_create_manager' (af5c78f6-07ec-4df3-8940-5950b8259642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4a1333-0a35-4603-bd02-5e99f79fe1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4a1333-0a35-4603-bd02-5e99f79fe1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03bc282-01ce-46f6-a17b-221f69d8eba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46f587a91144118a805abbae3fce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:35Z,use_quota=True,user_id='0ee05d30d65d4c7cb0b7b6ea885d529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ba9eb5-9506-41c9-afab-c015c3336bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ba9eb5-9506-41c9-afab-c015c3336bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d10f0-cd3f-4ab8-95ca-eabd48eebec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6.41c7a553-0f09-48d3-a54c-486a8e60e420" returned: 0 in 0.555s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-41c7a553-0f09-48d3-a54c-486a8e60e420" released by "_delete_snapshot" :: held 2.588s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Flow 'volume_create_manager' (f5185658-edb8-4472-a280-fb0f12dfb49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fe0c2-4643-4b02-ae30-5235426ad013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" released by "delete_snapshot" :: held 3.134s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fe0c2-4643-4b02-ae30-5235426ad013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea55b43-edde-4cb9-8947-be35018b8dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b626627bd6ce40d995ff0b8a2a0e9a79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0bb38f9-8518-498e-82a6-e1e0a16efbfb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:36Z,use_quota=True,user_id='7f0b8858814246059226b22a7f5a2cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa4b1f-3570-4f59-a8cf-b461c555e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa4b1f-3570-4f59-a8cf-b461c555e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5c9a5-4845-4938-8e40-27aeb5bca5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f5c9a5-4845-4938-8e40-27aeb5bca5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ea55b43-edde-4cb9-8947-be35018b8dc8', 'volume_name': 'volume-8ea55b43-edde-4cb9-8947-be35018b8dc8', 'volume_size': 1, 'snapshot_id': 'd0bb38f9-8518-498e-82a6-e1e0a16efbfb'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443ceb5a-a6b2-4612-89d6-cfe142927fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (443ceb5a-a6b2-4612-89d6-cfe142927fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd3e6d4-3e1e-4370-b72b-f3a653bf43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Volume 8ea55b43-edde-4cb9-8947-be35018b8dc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ea55b43-edde-4cb9-8947-be35018b8dc8', 'volume_size': 1, 'snapshot_id': 'd0bb38f9-8518-498e-82a6-e1e0a16efbfb'}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-8ea55b43-edde-4cb9-8947-be35018b8dc8" by "_create_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d10f0-cd3f-4ab8-95ca-eabd48eebec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f03bc282-01ce-46f6-a17b-221f69d8eba4', 'volume_name': 'volume-f03bc282-01ce-46f6-a17b-221f69d8eba4', 'volume_size': 1, 'image_id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98cffe8d93cc89620356dbb52d30edbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46f587a91144118a805abbae3fce40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b9c4c3a181708ab3f978267532d9a51c11af035f6b52cc1087cabe6f1045f795828a36323f8b2f30770e6003290d74841565e3a78fe49cd76e1ef4da5bafe8a', 'id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'created_at': datetime.datetime(2025, 9, 10, 15, 54, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 54, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61d59e21-ff12-4d34-bf3f-ff5e3c76b44c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dec07c0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11794c3e-d5e7-4909-8a20-2fe4fb9364e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11794c3e-d5e7-4909-8a20-2fe4fb9364e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3df28e0-36e7-485a-a76f-4e2d09578807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:36 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Volume f03bc282-01ce-46f6-a17b-221f69d8eba4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f03bc282-01ce-46f6-a17b-221f69d8eba4', 'volume_size': 1, 'image_id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98cffe8d93cc89620356dbb52d30edbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46f587a91144118a805abbae3fce40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b9c4c3a181708ab3f978267532d9a51c11af035f6b52cc1087cabe6f1045f795828a36323f8b2f30770e6003290d74841565e3a78fe49cd76e1ef4da5bafe8a', 'id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'created_at': datetime.datetime(2025, 9, 10, 15, 54, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 54, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61d59e21-ff12-4d34-bf3f-ff5e3c76b44c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dec07c0>}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Cloning f03bc282-01ce-46f6-a17b-221f69d8eba4 from image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c  at location (None, None). {{(pid=82884) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-8ea55b43-edde-4cb9-8947-be35018b8dc8" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Creating volume 8ea55b43-edde-4cb9-8947-be35018b8dc8 from snapshot d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" by "_copy_volume_from_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] snapshot: d0bb38f9-8518-498e-82a6-e1e0a16efbfb, volume: 8ea55b43-edde-4cb9-8947-be35018b8dc8,  {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['f0aa5f73-fd0d-4040-a076-491ca3bc640e', 'd278c3d2-197c-4b1b-a728-c2c3a9a134f3', 'e1734720-a695-4058-9a84-f1de7038c8bd', 'd0a9d479-52c6-4360-b841-8515657b8328'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca7a5f-011c-4ef7-8254-fd814395bdc8]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:36 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 17:54:37 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c358a40-9821-4fa5-bcbf-21f140895b56]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.766s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Creating direct copy from snapshot {{(pid=82884) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66dd896-91f8-4751-8fb7-b334b846e571]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:38 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD
Sep 10 17:54:38 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-836320ab-8c22-4557-8b50-21960d0f9fb6-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-836320ab-8c22-4557-8b50-21960d0f9fb6-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Delete snapshot completed successfully.
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-3e65a8f8-e3aa-46a4-9879-45aa82190b2a tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-41c7a553-0f09-48d3-a54c-486a8e60e420-delete_snapshot" released by "delete_snapshot" :: held 5.460s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:38 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 0.844s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.utils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 not found in is_blk_device check {{(pid=82884) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" acquired by "delete_volume" :: waited 0.166s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:38 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=162, name=volume-8ea55b43-edde-4cb9-8947-be35018b8dc8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d36e7f-b953-40fd-bd76-4724a5de7533]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:40 devstack quobyte-client[82918]: System call of process 100318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6" returned: 0 in 1.353s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-836320ab-8c22-4557-8b50-21960d0f9fb6" returned: 0 in 0.824s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:41 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-quobyte-836320ab-8c22-4557-8b50-21960d0f9fb6" released by "delete_volume" :: held 2.981s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:42 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Sep 10 17:54:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 0 in 5.255s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=77,cinder:UPDATE=115,cinder:DELETE=11,cinder:INSERT=24 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:54:43 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=112,cinder:SELECT=76,cinder:DELETE=13,cinder:INSERT=20 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Created reservations ['67596356-99b8-4e1b-afd4-19ee2f7cec66', 'e981b8de-c869-4f8c-a457-a603143062a0', '98d91b59-50e4-4181-8160-c5ab72498c5f', '1276e7bc-f6d0-43dc-abaf-fe92d2d6987f'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.089s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:45 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD
Sep 10 17:54:45 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:54:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.312s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:45 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:54:45 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Deleted volume successfully.
Sep 10 17:54:46 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-72f29588-afcc-4acf-b945-fa011bd60d4d tempest-CreateVolumesFromSnapshotTest-1313011660 None] Lock "cinder-836320ab-8c22-4557-8b50-21960d0f9fb6-delete_volume" released by "delete_volume" :: held 8.454s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8" returned: 0 in 9.185s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:47 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[3416d787-c763-44ce-97c9-3a74b3490920]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:47 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 0.940s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:48 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Image conversion details: src /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb, size 1024.00 MB, duration 9.19 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:54:48 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Converted 1024.00 MB image at 111.45 MB/s
Sep 10 17:54:48 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:54:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8" returned: 0 in 0.236s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" released by "_copy_volume_from_snapshot" :: held 12.598s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-8ea55b43-edde-4cb9-8947-be35018b8dc8" released by "_create_volume_from_snapshot" :: held 12.703s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.786s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:49 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 1 in 7.178s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Temporary image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c is fetched for user 0ee05d30d65d4c7cb0b7b6ea885d529d. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd3e6d4-3e1e-4370-b72b-f3a653bf43a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea55b43-edde-4cb9-8947-be35018b8dc8', 'volume_size': 1, 'snapshot_id': 'd0bb38f9-8518-498e-82a6-e1e0a16efbfb'}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:49 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fd66e0-e916-4878-a5ec-4eb23ed53042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:50 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Volume volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 (8ea55b43-edde-4cb9-8947-be35018b8dc8): created successfully
Sep 10 17:54:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fd66e0-e916-4878-a5ec-4eb23ed53042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:50 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Flow 'volume_create_manager' (f5185658-edb8-4472-a280-fb0f12dfb49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:50 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-399ada6e-be37-4735-8bbb-23bb9250355f tempest-SnapshotDependencyTests-568918210 None] Created volume successfully.
Sep 10 17:54:50 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[869cbcba-b3b6-4c4c-bf8e-c9aa42f1a22b]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:50 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD
Sep 10 17:54:50 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.169s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:51 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb" acquired by "_delete_snapshot" :: waited 0.081s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Deleting offline snapshot d0bb38f9-8518-498e-82a6-e1e0a16efbfb of volume 1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] snapshot_file for this snap is: volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e651418-32d8-433e-a206-9cab00b7cf50]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.559s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:54:52 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bea907-2215-4975-a3c8-5a5b18195b3b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:52 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:52 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (d21eba41-e4ab-4ccf-a166-24fa3ae2dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0907d4-7603-4e4f-8417-8e89ec716d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:53 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0907d4-7603-4e4f-8417-8e89ec716d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1605484909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71ac9e5-81e7-4b64-a46a-0d2b3243e72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:52Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cb2c0a-f727-4db2-8001-2c1813da2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56cb2c0a-f727-4db2-8001-2c1813da2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bbe37a-e457-4d99-97c2-0cdb16a88443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bbe37a-e457-4d99-97c2-0cdb16a88443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71ac9e5-81e7-4b64-a46a-0d2b3243e72b', 'volume_name': 'volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4fd474-4836-4db8-8758-f865979dbc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4fd474-4836-4db8-8758-f865979dbc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee8a546-6e1e-4f08-8b7c-e26c24868254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:53 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume a71ac9e5-81e7-4b64-a46a-0d2b3243e72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b', 'volume_size': 1}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1605484909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71ac9e5-81e7-4b64-a46a-0d2b3243e72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:52Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume a71ac9e5-81e7-4b64-a46a-0d2b3243e72b {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:53 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:53 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=163, name=volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 0 in 3.325s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 1.308s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:53 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b 1073741824" returned: 0 in 0.632s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:54 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD
Sep 10 17:54:54 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.418s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" returned: 0 in 0.305s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (1037ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb.d0bb38f9-8518-498e-82a6-e1e0a16efbfb" returned: 0 in 0.339s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee8a546-6e1e-4f08-8b7c-e26c24868254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e319601a-0e52-4f70-bb3e-e8f11d52c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-d0bb38f9-8518-498e-82a6-e1e0a16efbfb" released by "_delete_snapshot" :: held 3.251s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" released by "delete_snapshot" :: held 3.348s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:54 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b (a71ac9e5-81e7-4b64-a46a-0d2b3243e72b): created successfully
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e319601a-0e52-4f70-bb3e-e8f11d52c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:54 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (d21eba41-e4ab-4ccf-a166-24fa3ae2dc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:54 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f0a5bbd7-5b59-45ce-b8b1-b604a234e375 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Created reservations ['050f98fb-a0ed-4e09-b1ac-badd617d2b8d', 'd84e777e-5f1a-4775-977a-da065d741b2e', 'bd68fda0-c40d-4f96-beb5-21b315637c7c', 'f0b5a86e-09a9-43b5-845b-6bcf79c8f6f6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:54:55 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Delete snapshot completed successfully.
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-b1d92847-4d5f-4368-b011-b450bda722ff tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-d0bb38f9-8518-498e-82a6-e1e0a16efbfb-delete_snapshot" released by "delete_snapshot" :: held 3.821s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-1cd9842d-1b92-49cd-a51b-4f5aae1730eb-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-1cd9842d-1b92-49cd-a51b-4f5aae1730eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:55 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" acquired by "delete_volume" :: waited 0.013s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa0f87-cdc8-42e8-b36a-c8d164a54581]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:54:55 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 1.164s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:56 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:56 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Sep 10 17:54:57 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (0a266972-bbb9-479d-8285-dc4f20041297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d7fa5-a810-4f3b-8602-07681abc8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2d7fa5-a810-4f3b-8602-07681abc8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-196990733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b1966f-2ca6-4c19-8eea-5b1562c08799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:56Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f0349e-5716-4bdd-9dc0-5ebeecf45b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f0349e-5716-4bdd-9dc0-5ebeecf45b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73999f2-0448-4e25-90ec-28818565f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73999f2-0448-4e25-90ec-28818565f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b1966f-2ca6-4c19-8eea-5b1562c08799', 'volume_name': 'volume-20b1966f-2ca6-4c19-8eea-5b1562c08799', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c486a306-e396-4c31-8513-b37980ee4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c486a306-e396-4c31-8513-b37980ee4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d91b3c1-33f6-4798-ae17-3011f3974da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:57 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume 20b1966f-2ca6-4c19-8eea-5b1562c08799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b1966f-2ca6-4c19-8eea-5b1562c08799', 'volume_size': 1}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-196990733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b1966f-2ca6-4c19-8eea-5b1562c08799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:56Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume 20b1966f-2ca6-4c19-8eea-5b1562c08799 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:57 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:57 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:57 devstack quobyte-client[82918]: System call of process 100371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:57 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=164, name=volume-20b1966f-2ca6-4c19-8eea-5b1562c08799, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 1 in 4.531s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" returned: 0 in 1.400s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (a987c5ae-2b27-4737-9fc4-0157df2bb541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1565d-9cb5-40ed-acf4-df674da48b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-1cd9842d-1b92-49cd-a51b-4f5aae1730eb" released by "delete_volume" :: held 2.923s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 1073741824" returned: 0 in 0.861s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:58 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (9a9697b3-f7f9-4499-8902-e44e097d8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f7341-43d2-4072-9ee8-992b7ea31bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:58 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1f7341-43d2-4072-9ee8-992b7ea31bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427542503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff6731b-a18a-4aeb-a990-e640daddf19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:57Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b82714-74f6-40ee-a42e-e89db6eca8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b82714-74f6-40ee-a42e-e89db6eca8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa7436d-44fd-48e5-877a-94a469b42be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa7436d-44fd-48e5-877a-94a469b42be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff6731b-a18a-4aeb-a990-e640daddf19c', 'volume_name': 'volume-eff6731b-a18a-4aeb-a990-e640daddf19c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e504302b-232d-4420-85e8-8b4ffad2a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e504302b-232d-4420-85e8-8b4ffad2a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8be135-2619-4432-bb0e-810a0a2f6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume eff6731b-a18a-4aeb-a990-e640daddf19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff6731b-a18a-4aeb-a990-e640daddf19c', 'volume_size': 1}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (0802cd32-c48b-4288-bbd6-6b93be2f26cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf1dca-0f61-49bf-b681-cf2aec52aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1565d-9cb5-40ed-acf4-df674da48b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167829770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31024973-aeb7-425b-a629-7b35e9aa5ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:57Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97de7c2a-0b84-4876-8057-3511b6adf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97de7c2a-0b84-4876-8057-3511b6adf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86e2507-b68f-4369-bc7b-9705062b3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a86e2507-b68f-4369-bc7b-9705062b3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31024973-aeb7-425b-a629-7b35e9aa5ea9', 'volume_name': 'volume-31024973-aeb7-425b-a629-7b35e9aa5ea9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed62a8c-62f9-417b-92ce-0e1b4eba0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed62a8c-62f9-417b-92ce-0e1b4eba0814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfcd1fd-af38-45d1-a43f-d68a9246b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume 31024973-aeb7-425b-a629-7b35e9aa5ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31024973-aeb7-425b-a629-7b35e9aa5ea9', 'volume_size': 1}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799" returned: 0 in 0.626s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:54:59 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (3c74270f-54c8-4921-a974-9532f68d49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aedaad-8d2e-4d90-8dfe-aa5cbb9ef3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (1614ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03bc282-01ce-46f6-a17b-221f69d8eba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab46f587a91144118a805abbae3fce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:35Z,use_quota=True,user_id='0ee05d30d65d4c7cb0b7b6ea885d529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Creating volume f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:54:59 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:54:59 devstack quobyte-client[82918]: System call of process 100376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:54:59 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=165, name=volume-f03bc282-01ce-46f6-a17b-221f69d8eba4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf1dca-0f61-49bf-b681-cf2aec52aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804958238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2ca46e-0908-4844-8296-00bbff3c0997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:58Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d02fff9-37d4-449c-ac8d-09da087000c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d02fff9-37d4-449c-ac8d-09da087000c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e011b6f8-6515-481b-a522-348094dd4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e011b6f8-6515-481b-a522-348094dd4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2ca46e-0908-4844-8296-00bbff3c0997', 'volume_name': 'volume-ae2ca46e-0908-4844-8296-00bbff3c0997', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a6f7f4-a207-4b93-b5cf-5af4db8607be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a6f7f4-a207-4b93-b5cf-5af4db8607be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ce555-cb72-4dca-9956-8248e8581749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:54:59 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume ae2ca46e-0908-4844-8296-00bbff3c0997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2ca46e-0908-4844-8296-00bbff3c0997', 'volume_size': 1}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:54:59 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d91b3c1-33f6-4798-ae17-3011f3974da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b1966f-2ca6-4c19-8eea-5b1562c08799', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062c7381-8409-4b2f-81a3-20afcc457db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aedaad-8d2e-4d90-8dfe-aa5cbb9ef3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035486743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b111042f-eb26-4e59-a678-4af110f3aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:58Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f34382-b64a-4448-9a22-91f1625b1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f34382-b64a-4448-9a22-91f1625b1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951aface-bbdb-4142-bfc4-13b2fcc010bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951aface-bbdb-4142-bfc4-13b2fcc010bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b111042f-eb26-4e59-a678-4af110f3aed9', 'volume_name': 'volume-b111042f-eb26-4e59-a678-4af110f3aed9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca7fb28-d664-4f41-8857-e32b1999d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca7fb28-d664-4f41-8857-e32b1999d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20885578-f08b-467b-9c29-a8ce4bfd0df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume b111042f-eb26-4e59-a678-4af110f3aed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b111042f-eb26-4e59-a678-4af110f3aed9', 'volume_size': 1}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:00 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 (20b1966f-2ca6-4c19-8eea-5b1562c08799): created successfully
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062c7381-8409-4b2f-81a3-20afcc457db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (0a266972-bbb9-479d-8285-dc4f20041297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Created reservations ['8f3eceeb-1790-447d-844a-8c36bd9fd739', '992a5f76-4585-44cd-9086-f6bd71cd03aa', '1988b195-8841-4cd5-996e-c21a66bb35bd', 'e000e8bc-5acf-43d8-8500-f0956ee601eb'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 1073741824" returned: 0 in 0.815s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:00 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-bdb76bcd-7350-4a61-9531-86b01c89fa40 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 0 in 0.304s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] <== create_volume: return (1177ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1427542503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff6731b-a18a-4aeb-a990-e640daddf19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:57Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume eff6731b-a18a-4aeb-a990-e640daddf19c {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:00 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:00 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=166, name=volume-eff6731b-a18a-4aeb-a990-e640daddf19c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:00 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Attempting download of 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c ((None, None)) to volume f03bc282-01ce-46f6-a17b-221f69d8eba4. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 17:55:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c 1073741824" returned: 0 in 0.554s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:01 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-8ea55b43-edde-4cb9-8947-be35018b8dc8-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:01 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278a4c0-c79d-402f-9713-27efb80a8cd6]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:01 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_07hkd3c1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c" returned: 0 in 1.074s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (1680ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1167829770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31024973-aeb7-425b-a629-7b35e9aa5ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:57Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume 31024973-aeb7-425b-a629-7b35e9aa5ea9 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:02 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:02 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=167, name=volume-31024973-aeb7-425b-a629-7b35e9aa5ea9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:02 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-8ea55b43-edde-4cb9-8947-be35018b8dc8-delete_volume" acquired by "delete_volume" :: waited 1.233s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8be135-2619-4432-bb0e-810a0a2f6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff6731b-a18a-4aeb-a990-e640daddf19c', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e65530-ec50-4c3d-a680-b3b9427e7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_07hkd3c1" returned: 0 in 1.239s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_07hkd3c1 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 1073741824" returned: 0 in 1.054s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:03 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-eff6731b-a18a-4aeb-a990-e640daddf19c (eff6731b-a18a-4aeb-a990-e640daddf19c): created successfully
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e65530-ec50-4c3d-a680-b3b9427e7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (9a9697b3-f7f9-4499-8902-e44e097d8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:04 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6249dbcf-0856-4000-8d2d-c817e0e6cd4e tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_07hkd3c1" returned: 1 in 1.603s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_07hkd3c1' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9" returned: 0 in 0.854s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 1.309s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (2453ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.475s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:04 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a37d4ef-c764-47e5-85c2-497b5bc5d426]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.951s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804958238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2ca46e-0908-4844-8296-00bbff3c0997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:58Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume ae2ca46e-0908-4844-8296-00bbff3c0997 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:04 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:04 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:05 devstack quobyte-client[82918]: System call of process 100463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:05 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=168, name=volume-ae2ca46e-0908-4844-8296-00bbff3c0997, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 1.075s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfcd1fd-af38-45d1-a43f-d68a9246b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31024973-aeb7-425b-a629-7b35e9aa5ea9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a52c6c-ca71-4c45-81c5-5f6a64eaf72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:05 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Deleted volume successfully.
Sep 10 17:55:05 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" acquired by "delete_volume" :: waited 1.188s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997 1073741824" returned: 0 in 1.117s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895dc43-0348-48f3-9193-556f0c25cf47]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:06 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 (31024973-aeb7-425b-a629-7b35e9aa5ea9): created successfully
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a52c6c-ca71-4c45-81c5-5f6a64eaf72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (a987c5ae-2b27-4737-9fc4-0157df2bb541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:06 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8ecbaf0c-5739-43c8-b071-323584d5708c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997" returned: 0 in 0.773s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6b2de9f1-905d-4c85-8658-0b9cd9951a90 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-1cd9842d-1b92-49cd-a51b-4f5aae1730eb-delete_volume" released by "delete_volume" :: held 11.363s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:06 devstack quobyte-client[82918]: System call of process 100541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (1971ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 0 in 1.816s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.812s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1035486743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b111042f-eb26-4e59-a678-4af110f3aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f517c371bb14d5e94e9fe2fdab5c828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:54:58Z,use_quota=True,user_id='d9835f0cce9e4e0db98ea8b1276060e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Creating volume b111042f-eb26-4e59-a678-4af110f3aed9 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:06 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:06 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:07 devstack quobyte-client[82918]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:07 devstack quobyte-client[82918]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:07 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=169, name=volume-b111042f-eb26-4e59-a678-4af110f3aed9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8" returned: 0 in 0.996s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ce555-cb72-4dca-9956-8248e8581749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2ca46e-0908-4844-8296-00bbff3c0997', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0558795-79f7-43f6-aedc-6f6fe1b10b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9 1073741824" returned: 0 in 0.933s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:07 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:07 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-ae2ca46e-0908-4844-8296-00bbff3c0997 (ae2ca46e-0908-4844-8296-00bbff3c0997): created successfully
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0558795-79f7-43f6-aedc-6f6fe1b10b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (0802cd32-c48b-4288-bbd6-6b93be2f26cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-8ea55b43-edde-4cb9-8947-be35018b8dc8" returned: 0 in 0.827s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9" returned: 0 in 0.451s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD" returned: 1 in 1.226s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] <== create_volume: return (1414ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c was raw, converting to raw {{(pid=82884) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-quobyte-8ea55b43-edde-4cb9-8947-be35018b8dc8" released by "delete_volume" :: held 2.469s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:08 devstack quobyte-client[82918]: System call of process 100558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:08 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=165, name=volume-f03bc282-01ce-46f6-a17b-221f69d8eba4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:08 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4b43dace-7c1c-40ed-a64c-68eae2fc1bfc tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 0 in 0.482s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_61d59e21-ff12-4d34-bf3f-ff5e3c76b44c_hjo601pjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 17:55:08 devstack cinder-volume[82884]: INFO cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 17:55:08 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20885578-f08b-467b-9c29-a8ce4bfd0df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b111042f-eb26-4e59-a678-4af110f3aed9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6015c821-344b-462c-a006-6910307606dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:09 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume volume-b111042f-eb26-4e59-a678-4af110f3aed9 (b111042f-eb26-4e59-a678-4af110f3aed9): created successfully
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6015c821-344b-462c-a006-6910307606dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Flow 'volume_create_manager' (3c74270f-54c8-4921-a974-9532f68d49b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 1G" returned: 0 in 0.559s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:09 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-8ac0bd3d-4937-463e-abfe-09201165ee2c tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created volume successfully.
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc6ba3f-119c-41ad-9e41-c91e1d8abb48]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:09 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Created reservations ['9adeafa9-ed91-43b7-9fe9-f82e16608bbf', 'c8d15bb6-57b9-4ff2-8308-f1a9f3aca986', '7708400f-3175-4e23-aec2-954ad09dbb42', '01172c8e-3a9e-44c7-849d-cde5a35dc3c8'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 0 in 0.643s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:10 devstack quobyte-client[82918]: System call of process 100567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:10 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-b111042f-eb26-4e59-a678-4af110f3aed9-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 1 in 0.939s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.624s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Downloaded image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c ((None, None)) to volume f03bc282-01ce-46f6-a17b-221f69d8eba4 successfully. {{(pid=82884) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.image.image_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Temporary image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c for user 0ee05d30d65d4c7cb0b7b6ea885d529d is deleted. {{(pid=82884) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.volume_utils [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Marking volume f03bc282-01ce-46f6-a17b-221f69d8eba4 as bootable. {{(pid=82884) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-b111042f-eb26-4e59-a678-4af110f3aed9-delete_volume" acquired by "delete_volume" :: waited 0.327s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Copying metadata from image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c to f03bc282-01ce-46f6-a17b-221f69d8eba4. {{(pid=82884) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Creating volume glance metadata for volume f03bc282-01ce-46f6-a17b-221f69d8eba4 backed by image 61d59e21-ff12-4d34-bf3f-ff5e3c76b44c with: {'image_id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '98cffe8d93cc89620356dbb52d30edbc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82884) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 17:55:11 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Deleted volume successfully.
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3df28e0-36e7-485a-a76f-4e2d09578807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03bc282-01ce-46f6-a17b-221f69d8eba4', 'volume_size': 1, 'image_id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98cffe8d93cc89620356dbb52d30edbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab46f587a91144118a805abbae3fce40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b9c4c3a181708ab3f978267532d9a51c11af035f6b52cc1087cabe6f1045f795828a36323f8b2f30770e6003290d74841565e3a78fe49cd76e1ef4da5bafe8a', 'id': '61d59e21-ff12-4d34-bf3f-ff5e3c76b44c', 'created_at': datetime.datetime(2025, 9, 10, 15, 54, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 15, 54, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/61d59e21-ff12-4d34-bf3f-ff5e3c76b44c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f038dec07c0>}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab81131-28c1-4417-8091-60426b9d41cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:11 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-b111042f-eb26-4e59-a678-4af110f3aed9" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-4a497f79-6ec2-43cd-a51f-2789aa3b3163 tempest-SnapshotDependencyTests-568918210 None] Lock "cinder-8ea55b43-edde-4cb9-8947-be35018b8dc8-delete_volume" released by "delete_volume" :: held 8.813s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-b111042f-eb26-4e59-a678-4af110f3aed9" acquired by "delete_volume" :: waited 0.025s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a43523f-6b90-4aff-a0b2-945a84e45959]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:11 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Volume volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 (f03bc282-01ce-46f6-a17b-221f69d8eba4): created successfully
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab81131-28c1-4417-8091-60426b9d41cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:11 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Flow 'volume_create_manager' (af5c78f6-07ec-4df3-8940-5950b8259642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:12 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-253c656f-ab21-4483-bdd5-595d4ac73b0d tempest-VolumeImageDependencyTests-1904711470 None] Created volume successfully.
Sep 10 17:55:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9" returned: 0 in 1.026s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:12 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Acquiring lock "cinder-f03bc282-01ce-46f6-a17b-221f69d8eba4-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-b111042f-eb26-4e59-a678-4af110f3aed9" returned: 0 in 0.438s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "cinder-f03bc282-01ce-46f6-a17b-221f69d8eba4-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-b111042f-eb26-4e59-a678-4af110f3aed9" released by "delete_volume" :: held 1.788s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:13 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Acquiring lock "cinder-quobyte-f03bc282-01ce-46f6-a17b-221f69d8eba4" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['8cbbaa81-017e-4229-8bc6-0992205c8b6a', 'e0495d43-49b0-475c-bdf0-dcd2a5c8dcfd', '04e65968-01ea-4184-a632-50ab3d7b588b', '0cc1a8a9-68c0-476e-9a3f-e77ea9a7d29a'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "cinder-quobyte-f03bc282-01ce-46f6-a17b-221f69d8eba4" acquired by "delete_volume" :: waited 0.049s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9edb7f9-6382-48a7-91f1-5d63c10b8add]: (4, 'raw') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:13 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 0 in 0.624s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:14 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 1 in 0.452s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4' failed. Not Retrying. {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-f03bc282-01ce-46f6-a17b-221f69d8eba4" returned: 0 in 0.099s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "cinder-quobyte-f03bc282-01ce-46f6-a17b-221f69d8eba4" released by "delete_volume" :: held 1.429s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-ae2ca46e-0908-4844-8296-00bbff3c0997-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:15 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-ae2ca46e-0908-4844-8296-00bbff3c0997-delete_volume" acquired by "delete_volume" :: waited 0.668s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.707s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Created reservations ['a7cf9838-b86d-40e8-ad5b-1a9190489976', 'cb2717c3-ceff-41e3-8637-7b79a172c444', '93bce6b2-b332-4624-a9fb-1c959537759a', '2adcd25f-3fe2-4015-a235-bd6333a7f95e'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:16 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:16 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-ae2ca46e-0908-4844-8296-00bbff3c0997" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-75d4a3b9-0cb8-49ac-895b-2e49cbfe6345 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-b111042f-eb26-4e59-a678-4af110f3aed9-delete_volume" released by "delete_volume" :: held 5.382s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-ae2ca46e-0908-4844-8296-00bbff3c0997" acquired by "delete_volume" :: waited 0.084s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f29043-4051-49f2-80a5-df4903b0ba57]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:16 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.145s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:17 devstack quobyte-client[82918]: System call of process 100583 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:17 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Deleted volume successfully.
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997" returned: 0 in 0.767s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-ec828490-fa21-44d9-8547-c80dd8d6321d tempest-VolumeImageDependencyTests-1904711470 None] Lock "cinder-f03bc282-01ce-46f6-a17b-221f69d8eba4-delete_volume" released by "delete_volume" :: held 4.670s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-ae2ca46e-0908-4844-8296-00bbff3c0997" returned: 0 in 0.291s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:17 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-ae2ca46e-0908-4844-8296-00bbff3c0997" released by "delete_volume" :: held 1.228s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['be164937-aa69-4a14-a2dc-ec9eac130836', 'd5d4c0ca-6c11-4b6f-b21f-504f7b6345d2', 'a8514920-b542-475f-ab27-52ee68cf8a75', 'c3fda8e4-8a96-4803-8442-8ddad1ff7dd4'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.250s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:18 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:18 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-eff6731b-a18a-4aeb-a990-e640daddf19c-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-e76df9ab-247d-4629-9832-1cea35769ad3 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-ae2ca46e-0908-4844-8296-00bbff3c0997-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:19 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-eff6731b-a18a-4aeb-a990-e640daddf19c-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:20 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-eff6731b-a18a-4aeb-a990-e640daddf19c" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:20 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-eff6731b-a18a-4aeb-a990-e640daddf19c" acquired by "delete_volume" :: waited 0.037s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:20 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da3343-dc7a-4e98-8284-88edcd0696c9]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:20 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c" returned: 0 in 1.273s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:21 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-eff6731b-a18a-4aeb-a990-e640daddf19c" returned: 0 in 0.190s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:21 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-eff6731b-a18a-4aeb-a990-e640daddf19c" released by "delete_volume" :: held 1.773s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['e80196fa-b32d-4458-960e-918cb07edc12', '33247f27-0fa4-4433-8d52-7cbb2eac5131', 'bba64f5b-6bd1-4bc0-9156-7a480dd3119b', '4f6e11d4-9c42-4a1e-8683-cc72551cd4a7'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.146s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:22 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:22 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-595fdcad-20b1-4c60-85c1-c073d2b61e69 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-eff6731b-a18a-4aeb-a990-e640daddf19c-delete_volume" released by "delete_volume" :: held 3.770s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-31024973-aeb7-425b-a629-7b35e9aa5ea9-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-31024973-aeb7-425b-a629-7b35e9aa5ea9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:23 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-31024973-aeb7-425b-a629-7b35e9aa5ea9" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-31024973-aeb7-425b-a629-7b35e9aa5ea9" acquired by "delete_volume" :: waited 0.018s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61a896b-086f-48fa-aac2-6502acdaee31]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:23 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:24 devstack quobyte-client[82918]: System call of process 100718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9" returned: 0 in 0.699s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:24 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-31024973-aeb7-425b-a629-7b35e9aa5ea9" returned: 0 in 0.238s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-31024973-aeb7-425b-a629-7b35e9aa5ea9" released by "delete_volume" :: held 1.135s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['22b5d88c-32f4-4c57-8c0e-35c7dd335378', '38c9931c-9fc3-46f6-96f5-ce76affcef40', '1432a7a0-2505-4f15-9c6d-601f265af699', '56c43a6d-5664-4f83-9fde-9f0b45cd78fc'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.174s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:25 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:26 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-20b1966f-2ca6-4c19-8eea-5b1562c08799-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-fc672f96-8e72-40c0-af56-c315d7121f23 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-31024973-aeb7-425b-a629-7b35e9aa5ea9-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:26 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-20b1966f-2ca6-4c19-8eea-5b1562c08799-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:27 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-20b1966f-2ca6-4c19-8eea-5b1562c08799" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-20b1966f-2ca6-4c19-8eea-5b1562c08799" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[888d7703-c058-411a-b8fd-16a43519ff7f]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799" returned: 0 in 0.790s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:27 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-20b1966f-2ca6-4c19-8eea-5b1562c08799" returned: 0 in 0.177s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-20b1966f-2ca6-4c19-8eea-5b1562c08799" released by "delete_volume" :: held 1.247s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['9c3daa09-cb8c-4db0-8231-692c64fdc26a', '5f3c274e-ece8-443d-888a-e95fc04eeac3', '2371fa58-9e6d-4979-a9f6-8aaa256a09cd', '3cf3cb3e-1a3c-4218-85e2-7ef0a622e4c6'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:28 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:29 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.159s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:29 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:29 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:29 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-c8347eb3-706d-4777-aa42-e7452808885f tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-20b1966f-2ca6-4c19-8eea-5b1562c08799-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:30 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "cinder-quobyte-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" acquired by "delete_volume" :: waited 0.024s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df13052-5492-4550-b772-8ddc6c18b27b]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:30 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:31 devstack quobyte-client[82918]: System call of process 100731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" returned: 0 in 0.919s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:31 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" returned: 0 in 0.163s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:31 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-quobyte-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b" released by "delete_volume" :: held 1.400s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Created reservations ['11f6ae05-afa5-4082-b7f3-248e24c6cc7d', '336bfc08-da33-4a76-a1c0-0f528d379331', '02b97539-ccc6-4792-9877-3e5ad4d4bd53', '4f532dee-9b93-4f44-9a77-671d768040ce'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:32 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:33 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.147s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:33 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:33 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Deleted volume successfully.
Sep 10 17:55:33 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-6bc863a3-0998-425f-8fd1-0d26f323cc16 tempest-CreateVolumesFromSourceVolumeTest-1967781225 None] Lock "cinder-a71ac9e5-81e7-4b64-a46a-0d2b3243e72b-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:37 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Flow 'volume_create_manager' (52a36ffb-9d4f-4477-b984-d9cfeaa0de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a10ab-2819-40fd-941d-047cf2cffe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01a10ab-2819-40fd-941d-047cf2cffe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397f7b4d-6946-4cb2-afa4-34a956b998e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151f0291f77f4ed9ab369c397e31859f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:38Z,use_quota=True,user_id='5c9fbe424bf74544988662a3f83c78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f4d0c4-bf7f-4ac7-a10c-233bb7e34614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f4d0c4-bf7f-4ac7-a10c-233bb7e34614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3362015f-45fb-4494-839f-32bd460c7772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3362015f-45fb-4494-839f-32bd460c7772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '397f7b4d-6946-4cb2-afa4-34a956b998e9', 'volume_name': 'volume-397f7b4d-6946-4cb2-afa4-34a956b998e9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c049ebf-3ad9-4f70-8b3b-693e4247c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c049ebf-3ad9-4f70-8b3b-693e4247c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009692e9-4a64-428b-9fb0-d910b95b9532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:37 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Volume 397f7b4d-6946-4cb2-afa4-34a956b998e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-397f7b4d-6946-4cb2-afa4-34a956b998e9', 'volume_size': 1}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=397f7b4d-6946-4cb2-afa4-34a956b998e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151f0291f77f4ed9ab369c397e31859f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:38Z,use_quota=True,user_id='5c9fbe424bf74544988662a3f83c78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Creating volume 397f7b4d-6946-4cb2-afa4-34a956b998e9 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:37 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:37 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:38 devstack quobyte-client[82918]: System call of process 100737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:38 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=170, name=volume-397f7b4d-6946-4cb2-afa4-34a956b998e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 1073741824" returned: 0 in 0.366s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9" returned: 0 in 0.084s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] <== create_volume: return (540ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.552s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009692e9-4a64-428b-9fb0-d910b95b9532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-397f7b4d-6946-4cb2-afa4-34a956b998e9', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035d842-a551-4052-a0ec-e66f574868e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:38 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Volume volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 (397f7b4d-6946-4cb2-afa4-34a956b998e9): created successfully
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c035d842-a551-4052-a0ec-e66f574868e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:38 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Flow 'volume_create_manager' (52a36ffb-9d4f-4477-b984-d9cfeaa0de9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:38 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-0d30231f-bebd-49f6-ad39-6ed3e8897616 tempest-CinderUnicodeTest-376345182 None] Created volume successfully.
Sep 10 17:55:40 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82884) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Flow 'volume_create_manager' (ec513075-b06f-4094-baf9-019810336d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f147c5c4-269a-429e-8eb2-f4ff54cdd73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f147c5c4-269a-429e-8eb2-f4ff54cdd73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:55:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1372976967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac08e5f-0186-48fb-a578-acd95c42fef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151f0291f77f4ed9ab369c397e31859f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:40Z,use_quota=True,user_id='5c9fbe424bf74544988662a3f83c78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7624f2-d988-4813-83d0-dc1c16fa1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7624f2-d988-4813-83d0-dc1c16fa1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60543be1-b1d9-4d8a-b6b7-11a9ca41d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60543be1-b1d9-4d8a-b6b7-11a9ca41d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac08e5f-0186-48fb-a578-acd95c42fef3', 'volume_name': 'volume-aac08e5f-0186-48fb-a578-acd95c42fef3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865c6c90-d1ba-4048-ad0e-1ebb6ccd794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865c6c90-d1ba-4048-ad0e-1ebb6ccd794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57948dd-ff3a-46e3-be12-c16daba6cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:40 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Volume aac08e5f-0186-48fb-a578-acd95c42fef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac08e5f-0186-48fb-a578-acd95c42fef3', 'volume_size': 1}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0398c1fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T15:55:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1372976967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac08e5f-0186-48fb-a578-acd95c42fef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151f0291f77f4ed9ab369c397e31859f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T15:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T15:55:40Z,use_quota=True,user_id='5c9fbe424bf74544988662a3f83c78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c73a37e-e0ba-4353-82df-51ddbe950547),volume_type_id=7c73a37e-e0ba-4353-82df-51ddbe950547)}" {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Creating volume aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Selected 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e as target Quobyte volume. {{(pid=82884) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 17:55:40 devstack cinder-volume[82884]: INFO cinder.volume.drivers.remotefs [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] casted to 10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 1073741824 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:40 devstack quobyte-client[82918]: System call of process 100742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:40 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=171, name=volume-aac08e5f-0186-48fb-a578-acd95c42fef3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 1073741824" returned: 0 in 0.366s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:40 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3" returned: 0 in 0.101s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'} {{(pid=82884) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57948dd-ff3a-46e3-be12-c16daba6cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac08e5f-0186-48fb-a578-acd95c42fef3', 'volume_size': 1}' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d54470e-a61b-4787-a6fa-c0947d3441e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 17:55:41 devstack cinder-volume[82884]: INFO cinder.volume.flows.manager.create_volume [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Volume volume-aac08e5f-0186-48fb-a578-acd95c42fef3 (aac08e5f-0186-48fb-a578-acd95c42fef3): created successfully
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d54470e-a61b-4787-a6fa-c0947d3441e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82884) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 17:55:41 devstack cinder-volume[82884]: DEBUG cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Flow 'volume_create_manager' (ec513075-b06f-4094-baf9-019810336d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82884) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 17:55:41 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-f52fd097-ca86-4427-b936-e670bebbb70c tempest-CinderUnicodeTest-376345182 None] Created volume successfully.
Sep 10 17:55:42 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:42 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:42 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Creating offline snapshot 6a8d09b8-75dc-42ec-9d3e-4976846fa355 of volume aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ad0b57-da33-4eef-845c-672fb63c03a0]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3" returned: 0 in 0.441s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 1G {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:43 devstack quobyte-client[82918]: The server volume:a51b66ed-a7fe-4a27-802c-08c4ec2002c7@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a51b66ed-a7fe-4a27-802c-08c4ec2002c7, inode=172, name=volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.11), requestorAccessMask=0
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 1G" returned: 0 in 0.283s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): qemu-img rebase -u -b volume-aac08e5f-0186-48fb-a578-acd95c42fef3 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "qemu-img rebase -u -b volume-aac08e5f-0186-48fb-a578-acd95c42fef3 -F qcow2 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.143s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:55:43 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.096s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Setting permissions: /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 -> 1000:1000 {{(pid=82884) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.109s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.info" returned: 0 in 0.090s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] File path /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.info is being set with permissions: 660 {{(pid=82884) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.info {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.info" returned: 0 in 0.085s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:INSERT=31,cinder:UPDATE=111,cinder:SELECT=72,cinder:DELETE=15 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:55:44 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:UPDATE=102,cinder:DELETE=5,cinder:SELECT=61,cinder:INSERT=22 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:55:44 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-109797df-4457-4580-87a0-b5d47e6520f8 tempest-CinderUnicodeTest-376345182 None] Create snapshot completed successfully
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-6a8d09b8-75dc-42ec-9d3e-4976846fa355-delete_snapshot" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-6a8d09b8-75dc-42ec-9d3e-4976846fa355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:45 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" by "delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-quobyte-6a8d09b8-75dc-42ec-9d3e-4976846fa355" by "_delete_snapshot" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-6a8d09b8-75dc-42ec-9d3e-4976846fa355" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Deleting offline snapshot 6a8d09b8-75dc-42ec-9d3e-4976846fa355 of volume aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] snapshot_file for this snap is: volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[294572b8-2c03-4757-9e77-e75152ad1d63]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.406s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.remotefs [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aac08e5f-0186-48fb-a578-acd95c42fef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82884) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619d3bc-99c5-4617-8926-7bb789355d90]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:45 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3" returned: 0 in 0.568s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:46 devstack quobyte-client[82918]: System call of process 100765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 17:55:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.280s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:46 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3.6a8d09b8-75dc-42ec-9d3e-4976846fa355" returned: 0 in 0.137s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-6a8d09b8-75dc-42ec-9d3e-4976846fa355" released by "_delete_snapshot" :: held 1.809s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" released by "delete_snapshot" :: held 1.842s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:47 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Created reservations ['899f92c7-41ea-46b7-a31e-c47c9a033608', '60b19140-76d2-4d4b-a0db-ceb4bb79de2b', '3891b750-ee95-466a-806e-9c19992f6ee6', '05b96238-f8c3-4622-ba14-dfe706055012'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:47 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Delete snapshot completed successfully.
Sep 10 17:55:47 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-10dda87c-e9b9-4479-a99e-2cde85ff1929 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-6a8d09b8-75dc-42ec-9d3e-4976846fa355-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-aac08e5f-0186-48fb-a578-acd95c42fef3-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "cinder-aac08e5f-0186-48fb-a578-acd95c42fef3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:48 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" acquired by "delete_volume" :: waited 0.012s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f8b869-bd71-4e97-8824-d9318c60d05d]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:48 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3" returned: 0 in 0.464s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-aac08e5f-0186-48fb-a578-acd95c42fef3" returned: 0 in 0.109s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-aac08e5f-0186-48fb-a578-acd95c42fef3" released by "delete_volume" :: held 0.721s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Created reservations ['51d35291-084a-4eab-9350-2a1e6af4ff21', '232c6e64-4280-4b0c-8a00-6e273a1a6269', '48564ec5-1d3c-455f-bc9a-7874d626a1ab', 'e0968066-2d7a-4a49-8f37-eccd39e9f8f1'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.100s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:49 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:49 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Deleted volume successfully.
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-feded950-7635-4628-805e-592436a569ca tempest-CinderUnicodeTest-376345182 None] Lock "cinder-aac08e5f-0186-48fb-a578-acd95c42fef3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-397f7b4d-6946-4cb2-afa4-34a956b998e9-delete_volume" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-397f7b4d-6946-4cb2-afa4-34a956b998e9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:50 devstack cinder-volume[82884]: WARNING cinder.volume.volume_utils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "cinder-quobyte-397f7b4d-6946-4cb2-afa4-34a956b998e9" by "delete_volume" {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-397f7b4d-6946-4cb2-afa4-34a956b998e9" acquired by "delete_volume" :: waited 0.016s {{(pid=82884) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d74e31-0176-49d3-95dc-ce7efda09050]: (4, 'qcow2') {{(pid=84388) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 17:55:50 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9" returned: 0 in 0.416s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:51 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] CMD "rm -f /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83/volume-397f7b4d-6946-4cb2-afa4-34a956b998e9" returned: 0 in 0.093s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:51 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-quobyte-397f7b4d-6946-4cb2-afa4-34a956b998e9" released by "delete_volume" :: held 0.665s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:55:51 devstack cinder-volume[82884]: DEBUG cinder.quota [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Created reservations ['e85208dd-01f0-4941-b93d-79f10882d397', '9753d7c3-f18e-4fc3-ae68-5edd8d684fab', 'bd680ae2-f4f1-4306-a362-58e541a181da', 'dd44c4ed-0695-4b4a-badd-2c67573beb3c'] {{(pid=82884) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.097s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 17:55:52 devstack cinder-volume[82884]: INFO cinder.volume.manager [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Deleted volume successfully.
Sep 10 17:55:52 devstack cinder-volume[82884]: DEBUG cinder.coordination [None req-55ff0883-552c-42be-8f79-401e958c33d4 tempest-CinderUnicodeTest-376345182 None] Lock "cinder-397f7b4d-6946-4cb2-afa4-34a956b998e9-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82884) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 17:56:02 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:DELETE=1,cinder:SELECT=12,cinder:UPDATE=19,cinder:INSERT=4 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:56:02 devstack cinder-volume[82884]: DEBUG dbcounter [-] [82884] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=82884) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_service.periodic_task [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82884) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e': None} {{(pid=82884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG cinder.volume.drivers.quobyte [None req-47360287-e533-49de-a789-0e7de289d077 None None] Available shares ['10.10.41.181/cinder-vol-f10ef0d7-9bfa-4fea-a6e7-54392396a12e'] {{(pid=82884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.lockutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82884) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83 {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG oslo_concurrency.processutils [None req-47360287-e533-49de-a789-0e7de289d077 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8886d6785b8ffb7cbf1a0e3736aa3b83" returned: 0 in 0.116s {{(pid=82884) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 17:56:03 devstack cinder-volume[82884]: DEBUG cinder.manager [None req-47360287-e533-49de-a789-0e7de289d077 None None] Notifying Schedulers of capabilities ... {{(pid=82884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}